Jul 08 01:13:27 devstack cinder-volume[76122]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:13:27 devstack cinder-volume[76122]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:13:27 devstack cinder-volume[76122]: we strongly recommend against using it for new projects. Jul 08 01:13:27 devstack cinder-volume[76122]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:13:27 devstack cinder-volume[76122]: framework. For more detail see Jul 08 01:13:27 devstack cinder-volume[76122]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:13:27 devstack cinder-volume[76122]: import eventlet # noqa Jul 08 01:13:30 devstack cinder-volume[76122]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:13:30 devstack cinder-volume[76122]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:13:30 devstack cinder-volume[76122]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:13:31 devstack cinder-volume[76122]: INFO dbcounter [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Registered counter for database cinder Jul 08 01:13:31 devstack cinder-volume[76122]: DEBUG oslo_db.sqlalchemy.engines [None req-898fb4d9-3830-4580-8034-60e379218737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:13:31 devstack cinder-volume[76122]: DEBUG dbcounter [-] [76122] Writer thread running {{(pid=76122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:13:31 devstack cinder-volume[76122]: INFO cinder.rpc [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:13:31 devstack cinder-volume[76122]: INFO cinder.rpc [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:13:31 devstack cinder-volume[76122]: DEBUG oslo_db.sqlalchemy.engines [None req-898fb4d9-3830-4580-8034-60e379218737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:13:31 devstack cinder-volume[76122]: INFO cinder.volume.manager [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Determined volume DB was empty at startup. Jul 08 01:13:31 devstack cinder-volume[76122]: DEBUG cinder.volume.manager [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76122) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:13:31 devstack cinder-volume[76122]: INFO cinder.volume.manager [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 01:13:31 devstack cinder-volume[76122]: WARNING stevedore.named [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:13:31 devstack cinder-volume[76122]: WARNING castellan.key_manager [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:13:31 devstack cinder-volume[76122]: WARNING cinder.keymgr.conf_key_mgr [None req-898fb4d9-3830-4580-8034-60e379218737 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:13:31 devstack cinder-volume[76122]: DEBUG cinder.volume.drivers.lvm [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76122) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 01:13:31 devstack cinder-volume[76122]: DEBUG oslo_concurrency.processutils [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_concurrency.processutils [None req-898fb4d9-3830-4580-8034-60e379218737 None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=76122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_db.sqlalchemy.engines [None req-898fb4d9-3830-4580-8034-60e379218737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:13:32 devstack cinder-volume[76122]: INFO cinder.rpc [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 01:13:32 devstack cinder-volume[76122]: INFO cinder.rpc [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 01:13:32 devstack cinder-volume[76122]: WARNING stevedore.named [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:13:32 devstack cinder-volume[76122]: WARNING castellan.key_manager [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:13:32 devstack cinder-volume[76122]: INFO cinder.volume.manager [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_db.sqlalchemy.engines [None req-898fb4d9-3830-4580-8034-60e379218737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:13:32 devstack cinder-volume[76122]: INFO oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Starting 1 workers Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Started child 76284 {{(pid=76122) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Full set of CONF: {{(pid=76122) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] ******************************************************************************** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Configuration options gathered from: {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] ================================================================================ {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] allow_availability_zone_fallback = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] allow_compression_on_image_upload = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] allowed_direct_url_schemes = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] api_rate_limit = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] auth_strategy = keystone {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76284]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] az_cache_duration = 3600 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_availability_zone = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_host = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_stats_polling_interval = 60 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backup_api_class = cinder.backup.api.API {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backup_name_template = backup-%s {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backup_use_same_host = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backup_use_temp_snapshot = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] chap_password = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] chap_username = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cinder_internal_tenant_project_id = 424d328e62904e7897bb656870b9dd50 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cinder_internal_tenant_user_id = bac4d029589247c391aff95bca591963 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cloned_volume_same_az = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cluster = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] compression_format = gzip {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] compute_api_class = cinder.compute.nova.API {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] config_dir = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] config_source = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] control_exchange = openstack {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] debug = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] default_availability_zone = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] default_group_type = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] default_volume_type = lvmdriver-1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] disk_geometry = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] driver_client_cert = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] driver_client_cert_key = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] driver_data_namespace = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] driver_ssl_cert_path = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] driver_ssl_cert_verify = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] driver_use_ssl = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] enable_force_upload = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] enable_new_services = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] enable_unsupported_driver = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] enforce_multipath_for_image_xfer = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] filter_function = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_api_insecure = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_api_servers = ['http://192.168.122.197/image'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_api_ssl_compression = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_ca_certificates_file = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_catalog_info = image:glance:publicURL {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_certfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_keyfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_num_retries = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance_request_timeout = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] goodness_function = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] graceful_shutdown_timeout = 5 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] group_api_class = cinder.group.api.API {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] host = devstack {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_compress_on_upload = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_conversion_address_space_limit = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_conversion_cpu_limit = 60 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_conversion_disable = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_upload_use_cinder_backend = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_upload_use_internal_tenant = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_volume_cache_enabled = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_volume_cache_max_count = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] image_volume_cache_max_size_gb = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] init_host_max_objects_retrieval = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] instance_format = [instance: %(uuid)s] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] iscsi_target_flags = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] iscsi_write_cache = on {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] iser_helper = tgtadm {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] iser_ip_address = 192.168.122.197 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] iser_port = 3260 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] log_color = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] log_config_append = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] log_dir = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] log_file = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] log_options = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] log_rotate_interval = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] log_rotate_interval_type = days {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] log_rotation_type = none {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] max_age = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] max_logfile_count = 30 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] max_logfile_size_mb = 200 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] max_over_subscription_ratio = 20.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] message_reap_interval = 86400 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] message_ttl = 2592000 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] migration_create_volume_timeout_secs = 300 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] monkey_patch = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] monkey_patch_modules = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] my_ip = 192.168.122.197 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] no_snapshot_gb_quota = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] num_iser_scan_tries = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] num_shell_tries = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] num_volume_device_scan_tries = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] nvmeof_conn_info_version = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] nvmet_ns_id = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] nvmet_port_id = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76284]: INFO cinder.volume.manager [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] osapi_max_limit = 1000 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] osapi_volume_ext_list = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] osapi_volume_listen_port = 8776 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] osapi_volume_use_ssl = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] osapi_volume_workers = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] per_volume_size_limit = -1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] periodic_fuzzy_delay = 60 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] periodic_interval = 60 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] public_endpoint = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] publish_errors = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] quota_backup_gigabytes = 1000 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] quota_backups = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] quota_gigabytes = 1000 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] quota_groups = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] quota_snapshots = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] quota_volumes = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] rate_limit_burst = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] rate_limit_except_level = CRITICAL {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] rate_limit_interval = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] reinit_driver_count = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] replication_device = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] report_discard_supported = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] report_interval = 120 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] reservation_clean_interval = 86400 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] reservation_expire = 86400 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] reserved_image_namespaces = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] reserved_percentage = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] rpc_response_timeout = 120 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] run_external_periodic_tasks = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] scst_target_driver = iscsi {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] scst_target_iqn_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_down_time = 720 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] shell_completion = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] snapshot_name_template = snapshot-%s {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] snapshot_same_host = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] split_loggers = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] state_path = /opt/stack/data/cinder {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] storage_availability_zone = nova {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] storage_protocol = iSCSI {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] syslog_log_facility = LOG_USER {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] target_helper = lioadm {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] target_ip_address = 192.168.122.197 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] target_port = 3260 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] target_protocol = iscsi {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] target_secondary_ip_addresses = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] trace_flags = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] transport_url = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] until_refresh = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] use_chap_auth = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] use_default_quota_class = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] use_journal = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] use_json = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] use_multipath_for_image_xfer = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] use_stderr = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] use_syslog = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] verify_glance_signatures = enabled {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_api_class = cinder.volume.api.API {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_backend_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_clear = zero {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_clear_ionice = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_clear_size = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_copy_bps_limit = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_dd_blocksize = 1M {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_name_template = volume-%s {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_service_inithost_offload = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volume_usage_audit_period = month {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] zoning_mode = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_concurrency.disable_process_locking = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.auth_section = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.auth_type = password {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.auth_version = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.cache = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.certfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.include_service_catalog = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.insecure = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.interface = public {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.keyfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_password = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcache_username = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.region_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.service_type = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.197/identity {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.backend = dogpile.cache.null {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.backend_argument = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.backend_expiration_time = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.config_prefix = cache.oslo {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.debug_cache_backend = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.enable_retry_client = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.enable_socket_keepalive = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.enabled = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.expiration_time = 600 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.hashclient_retry_attempts = 2 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack sudo[76288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.memcache_dead_retry = 300 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.memcache_pool_maxsize = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.memcache_sasl_enabled = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack sudo[76288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.password = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.proxies = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.redis_db = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.redis_server = localhost:6379 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.retry_attempts = 2 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.retry_delay = 0.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.socket_keepalive_count = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.socket_keepalive_idle = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.socket_keepalive_interval = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.socket_timeout = 1.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.tls_allowed_ciphers = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.tls_cafile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.tls_certfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:32 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.tls_enabled = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.tls_keyfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cache.username = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] coordination.backend_url = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.asyncio_connection = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.asyncio_slave_connection = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.backend = sqlalchemy {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.connection = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.connection_debug = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.connection_parameters = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.connection_recycle_time = 3600 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.connection_trace = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.db_inc_retry_interval = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.db_max_retries = 20 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.db_max_retry_interval = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.db_retry_interval = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.max_overflow = 50 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.max_pool_size = 5 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.max_retries = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.mysql_wsrep_sync_wait = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.pool_timeout = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.retry_interval = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.slave_connection = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.sqlite_synchronous = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.synchronous_reader = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] database.use_db_reconnect = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.connection_string = messaging:// {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.enabled = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.es_doc_type = notification {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.es_scroll_size = 10000 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.es_scroll_time = 2m {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.filter_error_trace = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.hmac_keys = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.sentinel_service_name = mymaster {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.socket_timeout = 0.1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.trace_requests = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler.trace_sqlalchemy = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler_jaeger.process_tags = {} {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler_jaeger.service_name_prefix = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] profiler_otlp.service_name_prefix = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.enforce_new_defaults = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.enforce_scope = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.policy_default_rule = default {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.policy_file = policy.yaml {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] privsep_osbrick.group = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] privsep_osbrick.helper_command = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] privsep_osbrick.user = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cinder_sys_admin.group = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cinder_sys_admin.helper_command = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] cinder_sys_admin.user = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.auth_section = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.auth_type = password {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.cafile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.certfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.collect_timing = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.insecure = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.keyfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.send_service_user_token = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.split_loggers = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] service_user.timeout = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.auth_section = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.auth_type = password {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.certfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.collect_timing = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.insecure = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.keyfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.region_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.split_loggers = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] glance.timeout = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.backend_availability_zone = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.chap_password = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.chap_username = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.disk_geometry = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.driver_client_cert = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.driver_client_cert_key = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.driver_data_namespace = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.driver_use_ssl = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.extra_capabilities = {} {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.filter_function = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.goodness_function = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.iscsi_target_flags = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.iscsi_write_cache = on {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.iser_helper = tgtadm {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.iser_ip_address = 192.168.122.197 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.iser_port = 3260 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.lvm_share_target = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.lvm_type = auto {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.num_shell_tries = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.replication_device = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.report_discard_supported = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.reserved_percentage = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.target_helper = tgtadm {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.target_ip_address = 192.168.122.197 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.target_port = 3260 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.target_protocol = iscsi {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.trace_flags = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.unique_fqdn_network = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.use_chap_auth = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volume_backend_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volume_clear = zero {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volume_clear_ionice = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volume_clear_size = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_reports.file_event_handler = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_reports.log_dir = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.backend_host = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.chap_password = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.chap_username = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.disk_geometry = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.driver_client_cert = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.extra_capabilities = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.filter_function = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.goodness_function = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.iser_helper = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.iser_ip_address = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.iser_port = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.lvm_share_target = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.lvm_type = auto {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.num_shell_tries = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.replication_device = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.report_discard_supported = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.reserved_percentage = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.scst_target_driver = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.storage_protocol = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.target_helper = lioadm {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.target_ip_address = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.target_port = 3260 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.trace_flags = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.use_chap_auth = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volume_clear = zero {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volume_clear_size = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] lvmdriver-1.volumes_dir = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.ssl = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_notifications.driver = [] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_notifications.retry = -1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] key_manager.fixed_key = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.barbican_api_version = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.barbican_endpoint = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.barbican_endpoint_type = public {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.barbican_region_name = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.cafile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.certfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.collect_timing = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.insecure = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.keyfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.number_of_retries = 60 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.retry_delay = 1 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.send_service_user_token = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.split_loggers = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.timeout = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.verify_ssl = True {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican.verify_ssl_path = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican_service_user.auth_section = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican_service_user.auth_type = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican_service_user.cafile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican_service_user.certfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican_service_user.collect_timing = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican_service_user.insecure = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican_service_user.keyfile = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican_service_user.split_loggers = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] barbican_service_user.timeout = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.approle_role_id = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.approle_secret_id = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.kv_mountpoint = secret {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.kv_path = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.kv_version = 2 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.namespace = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.root_token_id = **** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.ssl_ca_crt_file = None {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.timeout = 60.0 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.use_ssl = False {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:13:32 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] ******************************************************************************** {{(pid=76122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:13:33 devstack sudo[76288]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:33 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.822s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:33 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:33 devstack sudo[76367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:13:33 devstack sudo[76367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:34 devstack sudo[76367]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:34 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.759s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:34 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:13:34 devstack cinder-volume[76284]: INFO cinder.brick.local_dev.lvm [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 01:13:34 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:34 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:34 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:34 devstack sudo[76640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:13:34 devstack sudo[76640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:35 devstack sudo[76640]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:35 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.845s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:35 devstack cinder-volume[76284]: DEBUG cinder.brick.local_dev.lvm [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76284) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 01:13:35 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:35 devstack sudo[76854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:13:35 devstack sudo[76854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:36 devstack sudo[76854]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:36 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.339s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:36 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:36 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:36 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:36 devstack sudo[77057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:13:36 devstack sudo[77057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:37 devstack sudo[77057]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:37 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.161s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:37 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:37 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:37 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:37 devstack sudo[77065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 01:13:37 devstack sudo[77065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:38 devstack sudo[77065]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:38 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.956s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:38 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:38 devstack sudo[77068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:13:38 devstack sudo[77068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:39 devstack sudo[77068]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:39 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.825s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:39 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:39 devstack sudo[77077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:13:39 devstack sudo[77077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:40 devstack sudo[77077]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:40 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.779s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:40 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:40 devstack sudo[77089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:13:40 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:41 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:41 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.747s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:41 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:41 devstack sudo[77094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:13:41 devstack sudo[77094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:41 devstack sudo[77094]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:41 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.721s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:41 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:41 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:41 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:41 devstack sudo[77098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:13:41 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:42 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:42 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.762s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:42 devstack cinder-volume[76284]: INFO cinder.volume.drivers.lvm [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 01:13:42 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:42 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:42 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:42 devstack cinder-volume[76122]: DEBUG dbcounter [-] [76122] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:13:42 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:13:42 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:43 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:43 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.916s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:43 devstack cinder-volume[76284]: DEBUG cinder.volume.drivers.lvm [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Updating volume stats {{(pid=76284) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:13:43 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:43 devstack sudo[77225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:13:43 devstack sudo[77225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:44 devstack sudo[77225]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:44 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.762s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:44 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:44 devstack sudo[77365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:13:44 devstack sudo[77365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:45 devstack sudo[77365]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:45 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.774s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:45 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:45 devstack sudo[77369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:13:45 devstack sudo[77369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:45 devstack sudo[77369]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:45 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.694s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:45 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:45 devstack sudo[77372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:13:45 devstack sudo[77372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:46 devstack sudo[77372]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:46 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.786s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:46 devstack cinder-volume[76284]: INFO cinder.volume.driver [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:13:46 devstack cinder-volume[76284]: DEBUG cinder.volume.driver [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76284) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:13:46 devstack cinder-volume[76284]: DEBUG oslo_db.sqlalchemy.engines [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76284) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:13:46 devstack cinder-volume[76284]: DEBUG dbcounter [-] [76284] Writer thread running {{(pid=76284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:13:46 devstack cinder-volume[76284]: DEBUG cinder.db.api [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Building query based on filter {{(pid=76284) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:13:46 devstack cinder-volume[76284]: DEBUG cinder.image.image_utils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76284) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:13:46 devstack cinder-volume[76284]: INFO cinder.keymgr.migration [None req-edafca75-761e-4558-bc95-896dad10daf4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:13:46 devstack cinder-volume[76284]: DEBUG cinder.volume.drivers.lvm [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Updating volume stats {{(pid=76284) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:13:46 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:46 devstack sudo[77376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:13:46 devstack sudo[77376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:47 devstack sudo[77376]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:47 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.744s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:47 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:47 devstack sudo[77379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:13:47 devstack sudo[77379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:48 devstack sudo[77379]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:48 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.757s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:48 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:48 devstack sudo[77385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:13:48 devstack sudo[77385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:48 devstack sudo[77385]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:48 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.801s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:48 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:49 devstack sudo[77388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:13:49 devstack sudo[77388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:49 devstack sudo[77388]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:49 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.776s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:49 devstack cinder-volume[76284]: DEBUG cinder.manager [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Notifying Schedulers of capabilities ... {{(pid=76284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:49 devstack cinder-volume[76284]: INFO cinder.volume.manager [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Driver initialization completed successfully. Jul 08 01:13:49 devstack cinder-volume[76284]: INFO cinder.manager [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Initiating service 2 cleanup Jul 08 01:13:49 devstack cinder-volume[76284]: INFO cinder.manager [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Service 2 cleanup completed. Jul 08 01:13:49 devstack cinder-volume[76284]: DEBUG cinder.service [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Creating RPC server for service cinder-volume {{(pid=76284) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:13:49 devstack cinder-volume[76284]: DEBUG cinder.service [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76284) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:13:49 devstack cinder-volume[76284]: INFO cinder.volume.manager [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 01:13:49 devstack cinder-volume[76284]: DEBUG cinder.volume.drivers.lvm [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Updating volume stats {{(pid=76284) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:13:49 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:50 devstack sudo[77392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:13:50 devstack sudo[77392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:50 devstack sudo[77392]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:50 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.742s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:50 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:50 devstack sudo[77396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:13:50 devstack sudo[77396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:51 devstack sudo[77396]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:51 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.766s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:51 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:51 devstack sudo[77403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:13:51 devstack sudo[77403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:52 devstack sudo[77403]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:52 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.767s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:52 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:52 devstack sudo[77496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:13:52 devstack sudo[77496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:52 devstack sudo[77496]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:52 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:52 devstack cinder-volume[76284]: INFO cinder.volume.manager [None req-18e6240a-670a-4dd1-8f09-8e3942d7d43d None None] Driver post RPC initialization completed successfully. Jul 08 01:14:02 devstack cinder-volume[76284]: DEBUG dbcounter [-] [76284] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:14:03 devstack cinder-volume[76284]: DEBUG dbcounter [-] [76284] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:14:28 devstack cinder-volume[76284]: DEBUG oslo_service.periodic_task [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running periodic task VolumeManager._thread_info {{(pid=76284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:14:28 devstack cinder-volume[76284]: DEBUG cinder.volume.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] thread count: 6 {{(pid=76284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:14:28 devstack cinder-volume[76284]: DEBUG cinder.volume.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] thread info: [<_MainThread(MainThread, started 129593163690112)>, , , , , ] {{(pid=76284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:15:28 devstack cinder-volume[76284]: DEBUG oslo_service.periodic_task [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:15:28 devstack cinder-volume[76284]: DEBUG cinder.volume.drivers.lvm [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Updating volume stats {{(pid=76284) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:15:28 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:29 devstack sudo[80401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:15:29 devstack sudo[80401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:29 devstack sudo[80401]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:29 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.797s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:29 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:29 devstack sudo[80943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:15:29 devstack sudo[80943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:30 devstack sudo[80943]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:30 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.782s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:30 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:30 devstack sudo[81303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:15:30 devstack sudo[81303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:31 devstack sudo[81303]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.712s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:31 devstack sudo[81715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:15:31 devstack sudo[81715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:31 devstack sudo[81715]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:31 devstack cinder-volume[76284]: DEBUG cinder.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Notifying Schedulers of capabilities ... {{(pid=76284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:31 devstack cinder-volume[76284]: DEBUG oslo_service.periodic_task [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running periodic task VolumeManager._thread_info {{(pid=76284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:15:31 devstack cinder-volume[76284]: DEBUG cinder.volume.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] thread count: 6 {{(pid=76284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:15:31 devstack cinder-volume[76284]: DEBUG cinder.volume.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] thread info: [<_MainThread(MainThread, started 129593163690112)>, , , , , ] {{(pid=76284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:16:02 devstack cinder-volume[76284]: DEBUG dbcounter [-] [76284] Writing DB stats cinder:SELECT=1 {{(pid=76284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:16:02 devstack cinder-volume[76284]: DEBUG dbcounter [-] [76284] Writing DB stats cinder:UPDATE=1 {{(pid=76284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:16:28 devstack cinder-volume[76284]: DEBUG oslo_service.periodic_task [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:16:28 devstack cinder-volume[76284]: DEBUG cinder.volume.drivers.lvm [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Updating volume stats {{(pid=76284) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:16:28 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:29 devstack sudo[83103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:16:29 devstack sudo[83103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:29 devstack sudo[83103]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:29 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.760s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:29 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:29 devstack sudo[83259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:16:29 devstack sudo[83259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:30 devstack sudo[83259]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:30 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.740s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:30 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:30 devstack sudo[83461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:16:30 devstack sudo[83461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:31 devstack sudo[83461]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:31 devstack sudo[83476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:16:31 devstack sudo[83476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:31 devstack sudo[83476]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:31 devstack cinder-volume[76284]: DEBUG cinder.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Notifying Schedulers of capabilities ... {{(pid=76284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:31 devstack cinder-volume[76284]: DEBUG oslo_service.periodic_task [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running periodic task VolumeManager._thread_info {{(pid=76284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:16:31 devstack cinder-volume[76284]: DEBUG cinder.volume.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] thread count: 6 {{(pid=76284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:16:31 devstack cinder-volume[76284]: DEBUG cinder.volume.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] thread info: [<_MainThread(MainThread, started 129593163690112)>, , , , , ] {{(pid=76284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:17:28 devstack cinder-volume[76284]: DEBUG oslo_service.periodic_task [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:17:28 devstack cinder-volume[76284]: DEBUG cinder.volume.drivers.lvm [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Updating volume stats {{(pid=76284) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:17:28 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:29 devstack sudo[84921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:17:29 devstack sudo[84921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:29 devstack sudo[84921]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:29 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:29 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:29 devstack sudo[84925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:17:29 devstack sudo[84925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:30 devstack sudo[84925]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:30 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.813s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:30 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:30 devstack sudo[84976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:17:30 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:31 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:31 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:17:31 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:31 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.727s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:31 devstack cinder-volume[76284]: DEBUG cinder.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Notifying Schedulers of capabilities ... {{(pid=76284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:31 devstack cinder-volume[76284]: DEBUG oslo_service.periodic_task [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running periodic task VolumeManager._thread_info {{(pid=76284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:17:31 devstack cinder-volume[76284]: DEBUG cinder.volume.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] thread count: 6 {{(pid=76284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:17:31 devstack cinder-volume[76284]: DEBUG cinder.volume.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] thread info: [<_MainThread(MainThread, started 129593163690112)>, , , , , ] {{(pid=76284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:18:02 devstack cinder-volume[76284]: DEBUG dbcounter [-] [76284] Writing DB stats cinder:SELECT=1 {{(pid=76284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:18:02 devstack cinder-volume[76284]: DEBUG dbcounter [-] [76284] Writing DB stats cinder:UPDATE=1 {{(pid=76284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:18:29 devstack cinder-volume[76284]: DEBUG oslo_service.periodic_task [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:18:29 devstack cinder-volume[76284]: DEBUG cinder.volume.drivers.lvm [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Updating volume stats {{(pid=76284) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:18:29 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:29 devstack sudo[85943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:18:29 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:29 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:29 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:29 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:29 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:18:29 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:30 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:30 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:30 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:30 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:18:30 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:31 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.680s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:31 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:18:31 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:31 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:31 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:31 devstack cinder-volume[76284]: DEBUG cinder.manager [None req-3e1875c8-fa32-45e6-a5cd-bedee10b69bc None None] Notifying Schedulers of capabilities ... {{(pid=76284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:49 devstack cinder-volume[76122]: INFO oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Caught SIGTERM, stopping children Jul 08 01:18:49 devstack cinder-volume[76122]: DEBUG oslo_concurrency.lockutils [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Acquiring lock "singleton_lock" {{(pid=76122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:18:49 devstack cinder-volume[76122]: DEBUG oslo_concurrency.lockutils [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Acquired lock "singleton_lock" {{(pid=76122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:18:49 devstack cinder-volume[76122]: DEBUG oslo_concurrency.lockutils [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Releasing lock "singleton_lock" {{(pid=76122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:18:49 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Stop services. {{(pid=76122) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 01:18:49 devstack cinder-volume[76122]: DEBUG oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Killing children. {{(pid=76122) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 01:18:49 devstack cinder-volume[76122]: INFO oslo_service.backend._eventlet.service [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Waiting on 1 children to exit Jul 08 01:18:54 devstack cinder-volume[76284]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 08 01:18:54 devstack cinder-volume[86478]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:18:54 devstack cinder-volume[86478]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:18:54 devstack cinder-volume[86478]: we strongly recommend against using it for new projects. Jul 08 01:18:54 devstack cinder-volume[86478]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:18:54 devstack cinder-volume[86478]: framework. For more detail see Jul 08 01:18:54 devstack cinder-volume[86478]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:18:54 devstack cinder-volume[86478]: import eventlet # noqa Jul 08 01:18:54 devstack cinder-volume[76284]: DEBUG oslo_concurrency.lockutils [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Acquiring lock "singleton_lock" {{(pid=76284) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:18:54 devstack cinder-volume[76284]: DEBUG oslo_concurrency.lockutils [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Acquired lock "singleton_lock" {{(pid=76284) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:18:54 devstack cinder-volume[76284]: DEBUG oslo_concurrency.lockutils [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Releasing lock "singleton_lock" {{(pid=76284) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:18:54 devstack cinder-volume[76284]: WARNING amqp [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:18:54 devstack cinder-volume[76284]: WARNING amqp [None req-898fb4d9-3830-4580-8034-60e379218737 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:18:57 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:18:57 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:18:57 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:18:57 devstack cinder-volume[86478]: INFO dbcounter [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Registered counter for database cinder Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_db.sqlalchemy.engines [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG dbcounter [-] [86478] Writer thread running {{(pid=86478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:18:58 devstack cinder-volume[86478]: INFO cinder.rpc [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:18:58 devstack cinder-volume[86478]: INFO cinder.rpc [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_db.sqlalchemy.engines [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:18:58 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Determined volume DB was empty at startup. Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG cinder.volume.manager [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86478) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:18:58 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 01:18:58 devstack cinder-volume[86478]: WARNING stevedore.named [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:18:58 devstack cinder-volume[86478]: WARNING castellan.key_manager [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:18:58 devstack cinder-volume[86478]: WARNING cinder.keymgr.conf_key_mgr [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:18:58 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_db.sqlalchemy.engines [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:18:58 devstack cinder-volume[86478]: INFO oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Starting 1 workers Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Started child 86695 {{(pid=86478) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Full set of CONF: {{(pid=86478) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] ******************************************************************************** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Configuration options gathered from: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] ================================================================================ {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:18:58 devstack cinder-volume[86695]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] allow_availability_zone_fallback = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] allow_compression_on_image_upload = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] allowed_direct_url_schemes = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] api_rate_limit = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] auth_strategy = keystone {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_availability_zone = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_host = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_stats_polling_interval = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backup_api_class = cinder.backup.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backup_name_template = backup-%s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backup_use_same_host = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backup_use_temp_snapshot = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] chap_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] chap_username = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cinder_internal_tenant_project_id = 424d328e62904e7897bb656870b9dd50 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cinder_internal_tenant_user_id = bac4d029589247c391aff95bca591963 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cluster = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] compression_format = gzip {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] compute_api_class = cinder.compute.nova.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] config_dir = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] config_source = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] control_exchange = openstack {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] debug = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] default_availability_zone = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] default_group_type = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] default_volume_type = QuobyteHD {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] disk_geometry = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] driver_client_cert = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] driver_client_cert_key = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] driver_data_namespace = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] driver_ssl_cert_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] driver_ssl_cert_verify = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] driver_use_ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] enable_new_services = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] enable_unsupported_driver = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] enabled_backends = ['QuobyteHD'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] enforce_multipath_for_image_xfer = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] filter_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_api_insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_api_servers = ['http://192.168.122.197/image'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_api_ssl_compression = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_ca_certificates_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_catalog_info = image:glance:publicURL {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_num_retries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance_request_timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] goodness_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] graceful_shutdown_timeout = 5 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] group_api_class = cinder.group.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] host = devstack {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_compress_on_upload = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_conversion_address_space_limit = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_conversion_cpu_limit = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86695]: INFO cinder.volume.manager [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_conversion_disable = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.remotefs [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86695) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_upload_use_cinder_backend = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_upload_use_internal_tenant = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_volume_cache_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_volume_cache_max_count = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] image_volume_cache_max_size_gb = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] init_host_max_objects_retrieval = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] instance_format = [instance: %(uuid)s] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] iscsi_target_flags = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] iscsi_write_cache = on {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] iser_helper = tgtadm {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] iser_ip_address = 192.168.122.197 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] iser_port = 3260 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] log_color = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] log_config_append = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] log_dir = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] log_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] log_options = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] log_rotate_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] log_rotate_interval_type = days {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] log_rotation_type = none {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] max_age = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] max_logfile_count = 30 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] max_logfile_size_mb = 200 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] max_over_subscription_ratio = 20.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] message_reap_interval = 86400 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] message_ttl = 2592000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] migration_create_volume_timeout_secs = 300 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] monkey_patch = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] monkey_patch_modules = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] my_ip = 192.168.122.197 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] no_snapshot_gb_quota = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] num_iser_scan_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] num_shell_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] num_volume_device_scan_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] nvmeof_conn_info_version = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] nvmet_ns_id = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] nvmet_port_id = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] osapi_max_limit = 1000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] osapi_volume_ext_list = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] osapi_volume_listen_port = 8776 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] osapi_volume_use_ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] osapi_volume_workers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] per_volume_size_limit = -1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] periodic_fuzzy_delay = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] periodic_interval = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] public_endpoint = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] publish_errors = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] quota_backup_gigabytes = 1000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] quota_backups = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] quota_gigabytes = 1000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] quota_groups = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] quota_snapshots = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] quota_volumes = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] rate_limit_burst = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] rate_limit_except_level = CRITICAL {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] rate_limit_interval = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] reinit_driver_count = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] replication_device = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] report_discard_supported = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] report_interval = 120 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] reservation_clean_interval = 86400 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] reservation_expire = 86400 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] reserved_image_namespaces = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] reserved_percentage = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] rpc_response_timeout = 120 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] run_external_periodic_tasks = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] scst_target_driver = iscsi {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] scst_target_iqn_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_down_time = 720 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] shell_completion = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] snapshot_name_template = snapshot-%s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] state_path = /opt/stack/data/cinder {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] storage_availability_zone = nova {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] storage_protocol = iSCSI {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] syslog_log_facility = LOG_USER {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] target_helper = lioadm {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] target_ip_address = 192.168.122.197 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] target_port = 3260 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] target_protocol = iscsi {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] target_secondary_ip_addresses = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] trace_flags = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] transport_url = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] until_refresh = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] use_chap_auth = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] use_default_quota_class = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] use_journal = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] use_json = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] use_multipath_for_image_xfer = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] use_stderr = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] use_syslog = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] verify_glance_signatures = enabled {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_api_class = cinder.volume.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_backend_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_clear = zero {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:58 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_clear_ionice = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_clear_size = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86695) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 01:18:59 devstack cinder-volume[86695]: WARNING cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 01:18:59 devstack cinder-volume[86695]: WARNING cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_copy_bps_limit = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_dd_blocksize = 1M {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_name_template = volume-%s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_service_inithost_offload = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volume_usage_audit_period = month {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] zoning_mode = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:18:59 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Running cmd (subprocess): mount.quobyte {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_concurrency.disable_process_locking = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.auth_section = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.auth_type = password {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.auth_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.cache = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.include_service_catalog = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.interface = public {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_password = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcache_username = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.region_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.service_type = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.197/identity {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.backend = dogpile.cache.null {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.backend_argument = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.backend_expiration_time = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.config_prefix = cache.oslo {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.debug_cache_backend = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.enable_retry_client = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.enable_socket_keepalive = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.expiration_time = 600 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.hashclient_retry_attempts = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.memcache_dead_retry = 300 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.memcache_pool_maxsize = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.memcache_sasl_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.proxies = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.redis_db = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.redis_server = localhost:6379 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.retry_attempts = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.retry_delay = 0.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.socket_keepalive_count = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.socket_keepalive_idle = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.socket_keepalive_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.socket_timeout = 1.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.tls_allowed_ciphers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.tls_cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.tls_certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.tls_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.tls_keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cache.username = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] coordination.backend_url = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.asyncio_connection = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.asyncio_slave_connection = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.backend = sqlalchemy {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.connection = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.connection_debug = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.connection_parameters = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.connection_recycle_time = 3600 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.connection_trace = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.db_inc_retry_interval = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.db_max_retries = 20 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.db_max_retry_interval = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.db_retry_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.max_overflow = 50 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.max_pool_size = 5 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.max_retries = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.mysql_wsrep_sync_wait = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.pool_timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.retry_interval = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.slave_connection = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.sqlite_synchronous = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.synchronous_reader = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] database.use_db_reconnect = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.connection_string = messaging:// {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.es_doc_type = notification {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.es_scroll_size = 10000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.es_scroll_time = 2m {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack quobyte-client[86696]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.filter_error_trace = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.hmac_keys = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.sentinel_service_name = mymaster {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.socket_timeout = 0.1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.trace_requests = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler.trace_sqlalchemy = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack quobyte-client[86696]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 01:18:59 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler_jaeger.process_tags = {} {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler_jaeger.service_name_prefix = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:59 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:59 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=86695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] profiler_otlp.service_name_prefix = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.enforce_new_defaults = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.enforce_scope = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.policy_default_rule = default {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.policy_file = policy.yaml {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86695]: INFO cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb ... Jul 08 01:18:59 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff -c /etc/quobyte/client-cinder.cfg {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] privsep_osbrick.group = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] privsep_osbrick.helper_command = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] privsep_osbrick.user = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cinder_sys_admin.group = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cinder_sys_admin.helper_command = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] cinder_sys_admin.user = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.auth_section = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.auth_type = password {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.collect_timing = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.send_service_user_token = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] service_user.timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.auth_section = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.auth_type = password {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.collect_timing = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.region_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] glance.timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.backend_availability_zone = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff -c /etc/quobyte/client-cinder.cfg Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.chap_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.chap_username = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.disk_geometry = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.driver_client_cert = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.driver_client_cert_key = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.driver_data_namespace = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.driver_use_ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.extra_capabilities = {} {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.filter_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.goodness_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.iscsi_target_flags = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.iscsi_write_cache = on {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.iser_helper = tgtadm {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.iser_ip_address = 192.168.122.197 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.iser_port = 3260 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_host = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_login = admin {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_mount_options = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_private_key = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_share_path = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.num_shell_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.quobyte_volume_url = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.replication_device = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.report_discard_supported = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.reserved_percentage = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.target_helper = tgtadm {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.target_ip_address = 192.168.122.197 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.target_port = 3260 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.target_protocol = iscsi {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.trace_flags = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.unique_fqdn_network = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.use_chap_auth = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.volume_backend_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.volume_clear = zero {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.volume_clear_ionice = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.volume_clear_size = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_reports.file_event_handler = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_reports.log_dir = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.backend_availability_zone = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.backend_host = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.chap_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.chap_username = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.chiscsi_conf = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.disk_geometry = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.driver_client_cert = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.driver_data_namespace = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.driver_use_ssl = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.extra_capabilities = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.filter_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.goodness_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.iser_helper = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.iser_ip_address = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.iser_port = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.iser_target_prefix = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_host = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_login = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_mount_options = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_private_key = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_share_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_ssh_port = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.num_shell_tries = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.nvmet_port_id = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.replication_device = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.report_discard_supported = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.reserved_percentage = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.scst_target_driver = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.storage_protocol = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.target_helper = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.target_ip_address = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.target_port = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.target_prefix = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.target_protocol = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.trace_flags = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.use_chap_auth = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.volume_clear = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.volume_clear_size = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] QuobyteHD.volumes_dir = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_notifications.driver = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_notifications.retry = -1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] key_manager.fixed_key = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.barbican_api_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.barbican_endpoint = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.barbican_endpoint_type = public {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.barbican_region_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.collect_timing = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.number_of_retries = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.retry_delay = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.send_service_user_token = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.verify_ssl = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican.verify_ssl_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican_service_user.auth_section = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican_service_user.auth_type = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican_service_user.cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican_service_user.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican_service_user.collect_timing = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican_service_user.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican_service_user.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican_service_user.split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] barbican_service_user.timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.approle_role_id = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.approle_secret_id = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.kv_mountpoint = secret {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.kv_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.kv_version = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.namespace = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.root_token_id = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.ssl_ca_crt_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.timeout = 60.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.use_ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:18:59 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] ******************************************************************************** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:19:00 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.906s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:00 devstack cinder-volume[86695]: INFO cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb succeeded Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=86695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.924s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:00 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:19:00 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:00 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.726s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:00 devstack cinder-volume[86695]: INFO cinder.volume.driver [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG cinder.volume.driver [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5856590270996, 'free_capacity_gb': 1775.5856590270996, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86695) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG oslo_db.sqlalchemy.engines [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86695) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG dbcounter [-] [86695] Writer thread running {{(pid=86695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG cinder.db.api [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Building query based on filter {{(pid=86695) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG cinder.image.image_utils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86695) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:19:00 devstack cinder-volume[86695]: INFO cinder.keymgr.migration [None req-1ff69c43-f4a4-4d34-91cd-e18dcc47dd43 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=86695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=86695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:00 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:00 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:19:00 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:01 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:01 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.027s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:01 devstack cinder-volume[86695]: DEBUG cinder.manager [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Notifying Schedulers of capabilities ... {{(pid=86695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:19:02 devstack cinder-volume[86695]: INFO cinder.volume.manager [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Driver initialization completed successfully. Jul 08 01:19:02 devstack cinder-volume[86695]: INFO cinder.manager [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Initiating service 3 cleanup Jul 08 01:19:02 devstack cinder-volume[86695]: INFO cinder.manager [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Service 3 cleanup completed. Jul 08 01:19:02 devstack cinder-volume[86695]: DEBUG cinder.service [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Creating RPC server for service cinder-volume {{(pid=86695) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:19:02 devstack cinder-volume[86695]: DEBUG cinder.service [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86695) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:19:02 devstack cinder-volume[86695]: INFO cinder.volume.manager [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 01:19:02 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:02 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:02 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=86695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:02 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=86695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:02 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:02 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:02 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:19:02 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:03 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:03 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.814s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:03 devstack cinder-volume[86695]: INFO cinder.volume.manager [None req-b3d2917a-0b55-4096-82d3-033573a795a6 None None] Driver post RPC initialization completed successfully. Jul 08 01:19:05 devstack cinder-volume[86478]: INFO oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Caught SIGTERM, stopping children Jul 08 01:19:05 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Acquiring lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:19:05 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Acquired lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:19:05 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Releasing lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:19:05 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Stop services. {{(pid=86478) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 01:19:05 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Killing children. {{(pid=86478) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 01:19:05 devstack cinder-volume[86478]: INFO oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Waiting on 1 children to exit Jul 08 01:19:06 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Acquiring lock "singleton_lock" {{(pid=86695) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:19:06 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Acquired lock "singleton_lock" {{(pid=86695) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:19:06 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Releasing lock "singleton_lock" {{(pid=86695) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:19:06 devstack cinder-volume[86695]: WARNING amqp [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:19:06 devstack cinder-volume[86695]: WARNING amqp [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:19:06 devstack cinder-volume[86478]: INFO oslo_service.backend._eventlet.service [None req-10747e0a-65f7-4936-ac6d-d185aa4cf336 None None] Child 86695 exited with status 0 Jul 08 01:19:07 devstack cinder-volume[86965]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:19:07 devstack cinder-volume[86965]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:19:07 devstack cinder-volume[86965]: we strongly recommend against using it for new projects. Jul 08 01:19:07 devstack cinder-volume[86965]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:19:07 devstack cinder-volume[86965]: framework. For more detail see Jul 08 01:19:07 devstack cinder-volume[86965]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:19:07 devstack cinder-volume[86965]: import eventlet # noqa Jul 08 01:19:09 devstack cinder-volume[86965]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:19:09 devstack cinder-volume[86965]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:19:09 devstack cinder-volume[86965]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:19:11 devstack cinder-volume[86965]: INFO dbcounter [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Registered counter for database cinder Jul 08 01:19:11 devstack cinder-volume[86965]: DEBUG oslo_db.sqlalchemy.engines [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:19:11 devstack cinder-volume[86965]: DEBUG dbcounter [-] [86965] Writer thread running {{(pid=86965) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:19:11 devstack cinder-volume[86965]: INFO cinder.rpc [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:19:11 devstack cinder-volume[86965]: INFO cinder.rpc [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:19:11 devstack cinder-volume[86965]: DEBUG oslo_db.sqlalchemy.engines [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:19:11 devstack cinder-volume[86965]: INFO cinder.volume.manager [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Determined volume DB was empty at startup. Jul 08 01:19:11 devstack cinder-volume[86965]: DEBUG cinder.volume.manager [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86965) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:19:11 devstack cinder-volume[86965]: WARNING stevedore.named [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:19:11 devstack cinder-volume[86965]: WARNING castellan.key_manager [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:19:11 devstack cinder-volume[86965]: WARNING cinder.keymgr.conf_key_mgr [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:19:11 devstack cinder-volume[86965]: INFO cinder.volume.manager [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_db.sqlalchemy.engines [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:19:12 devstack cinder-volume[86965]: INFO oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Starting 1 workers Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Started child 87204 {{(pid=86965) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Full set of CONF: {{(pid=86965) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] ******************************************************************************** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] Configuration options gathered from: {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] ================================================================================ {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] allow_availability_zone_fallback = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] allow_compression_on_image_upload = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] allowed_direct_url_schemes = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] api_rate_limit = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] auth_strategy = keystone {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_availability_zone = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_host = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[87204]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_stats_polling_interval = 60 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backup_api_class = cinder.backup.api.API {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backup_name_template = backup-%s {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backup_use_same_host = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backup_use_temp_snapshot = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] chap_password = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] chap_username = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cinder_internal_tenant_project_id = 424d328e62904e7897bb656870b9dd50 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cinder_internal_tenant_user_id = bac4d029589247c391aff95bca591963 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cluster = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] compression_format = gzip {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] compute_api_class = cinder.compute.nova.API {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] config_dir = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] config_source = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] control_exchange = openstack {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] debug = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] default_availability_zone = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] default_group_type = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] default_volume_type = QuobyteHD {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] disk_geometry = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] driver_client_cert = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] driver_client_cert_key = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] driver_data_namespace = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] driver_ssl_cert_path = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] driver_ssl_cert_verify = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] driver_use_ssl = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] enable_new_services = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] enable_unsupported_driver = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] enabled_backends = ['QuobyteHD'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] enforce_multipath_for_image_xfer = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] filter_function = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_api_insecure = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_api_servers = ['http://192.168.122.197/image'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_api_ssl_compression = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_ca_certificates_file = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_catalog_info = image:glance:publicURL {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_certfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_keyfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_num_retries = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance_request_timeout = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] goodness_function = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] graceful_shutdown_timeout = 5 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] group_api_class = cinder.group.api.API {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] host = devstack {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_compress_on_upload = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_conversion_address_space_limit = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_conversion_cpu_limit = 60 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_conversion_disable = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_upload_use_cinder_backend = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_upload_use_internal_tenant = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_volume_cache_enabled = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_volume_cache_max_count = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] image_volume_cache_max_size_gb = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] init_host_max_objects_retrieval = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] instance_format = [instance: %(uuid)s] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] iscsi_target_flags = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] iscsi_write_cache = on {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] iser_helper = tgtadm {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] iser_ip_address = 192.168.122.197 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] iser_port = 3260 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] log_color = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] log_config_append = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] log_dir = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] log_file = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] log_options = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] log_rotate_interval = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] log_rotate_interval_type = days {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] log_rotation_type = none {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] max_age = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] max_logfile_count = 30 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] max_logfile_size_mb = 200 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] max_over_subscription_ratio = 20.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] message_reap_interval = 86400 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] message_ttl = 2592000 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] migration_create_volume_timeout_secs = 300 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] monkey_patch = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] monkey_patch_modules = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] my_ip = 192.168.122.197 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] no_snapshot_gb_quota = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] num_iser_scan_tries = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] num_shell_tries = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] num_volume_device_scan_tries = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] nvmeof_conn_info_version = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] nvmet_ns_id = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] nvmet_port_id = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] osapi_max_limit = 1000 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] osapi_volume_ext_list = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] osapi_volume_listen_port = 8776 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] osapi_volume_use_ssl = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] osapi_volume_workers = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87204) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] per_volume_size_limit = -1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] periodic_fuzzy_delay = 60 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] periodic_interval = 60 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] public_endpoint = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] publish_errors = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] quota_backup_gigabytes = 1000 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] quota_backups = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] quota_gigabytes = 1000 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] quota_groups = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] quota_snapshots = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] quota_volumes = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] rate_limit_burst = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] rate_limit_except_level = CRITICAL {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] rate_limit_interval = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] reinit_driver_count = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] replication_device = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] report_discard_supported = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] report_interval = 120 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] reservation_clean_interval = 86400 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] reservation_expire = 86400 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] reserved_image_namespaces = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] reserved_percentage = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] rpc_response_timeout = 120 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] run_external_periodic_tasks = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] scst_target_driver = iscsi {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] scst_target_iqn_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_down_time = 720 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] shell_completion = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] snapshot_name_template = snapshot-%s {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] split_loggers = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] state_path = /opt/stack/data/cinder {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] storage_availability_zone = nova {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] storage_protocol = iSCSI {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] syslog_log_facility = LOG_USER {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] target_helper = lioadm {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] target_ip_address = 192.168.122.197 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] target_port = 3260 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] target_protocol = iscsi {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] target_secondary_ip_addresses = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] trace_flags = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] transport_url = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] until_refresh = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] use_chap_auth = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] use_default_quota_class = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] use_journal = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] use_json = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] use_multipath_for_image_xfer = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] use_stderr = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] use_syslog = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] verify_glance_signatures = enabled {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_api_class = cinder.volume.api.API {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_backend_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_clear = zero {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_clear_ionice = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_clear_size = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_copy_bps_limit = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_dd_blocksize = 1M {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_name_template = volume-%s {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_service_inithost_offload = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volume_usage_audit_period = month {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87204) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 01:19:12 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.quobyte [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] zoning_mode = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_concurrency.disable_process_locking = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.quobyte [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Running cmd (subprocess): mount.quobyte {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.auth_section = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.auth_type = password {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.auth_version = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.cache = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.certfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.include_service_catalog = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.insecure = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.interface = public {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.keyfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_password = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcache_username = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.region_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.service_type = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.197/identity {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.backend = dogpile.cache.null {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.backend_argument = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.backend_expiration_time = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.config_prefix = cache.oslo {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.debug_cache_backend = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.enable_retry_client = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.enable_socket_keepalive = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.enabled = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.expiration_time = 600 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.hashclient_retry_attempts = 2 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.memcache_dead_retry = 300 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.memcache_pool_maxsize = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.memcache_sasl_enabled = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.password = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.proxies = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.redis_db = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.redis_server = localhost:6379 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.retry_attempts = 2 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.retry_delay = 0.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.socket_keepalive_count = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.socket_keepalive_idle = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.socket_keepalive_interval = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.socket_timeout = 1.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.tls_allowed_ciphers = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.tls_cafile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.tls_certfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.tls_enabled = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.tls_keyfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cache.username = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] coordination.backend_url = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.asyncio_connection = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.asyncio_slave_connection = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.backend = sqlalchemy {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.connection = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.connection_debug = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.connection_parameters = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.connection_recycle_time = 3600 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.connection_trace = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.db_inc_retry_interval = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.db_max_retries = 20 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.db_max_retry_interval = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack quobyte-client[87216]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.db_retry_interval = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.max_overflow = 50 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.max_pool_size = 5 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.max_retries = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.mysql_wsrep_sync_wait = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack quobyte-client[87216]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.pool_timeout = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.retry_interval = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] CMD "mount.quobyte" returned: 1 in 0.123s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.slave_connection = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.sqlite_synchronous = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.synchronous_reader = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] database.use_db_reconnect = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.connection_string = messaging:// {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.enabled = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.es_doc_type = notification {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.es_scroll_size = 10000 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.es_scroll_time = 2m {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.filter_error_trace = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.hmac_keys = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.sentinel_service_name = mymaster {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.socket_timeout = 0.1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.trace_requests = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler.trace_sqlalchemy = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler_jaeger.process_tags = {} {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler_jaeger.service_name_prefix = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] profiler_otlp.service_name_prefix = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.enforce_new_defaults = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.enforce_scope = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.policy_default_rule = default {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.policy_file = policy.yaml {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] privsep_osbrick.group = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] privsep_osbrick.helper_command = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] privsep_osbrick.user = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cinder_sys_admin.group = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cinder_sys_admin.helper_command = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] cinder_sys_admin.user = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.auth_section = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.auth_type = password {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.cafile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.certfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.collect_timing = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.insecure = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.keyfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.send_service_user_token = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.split_loggers = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] service_user.timeout = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.auth_section = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.auth_type = password {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.certfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.collect_timing = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.insecure = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.keyfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.region_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.split_loggers = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] glance.timeout = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.backend_availability_zone = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.chap_password = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.chap_username = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.disk_geometry = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.driver_client_cert = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.driver_client_cert_key = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.driver_data_namespace = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.driver_use_ssl = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.extra_capabilities = {} {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.filter_function = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.goodness_function = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.iscsi_target_flags = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.iscsi_write_cache = on {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.iser_helper = tgtadm {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.iser_ip_address = 192.168.122.197 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.iser_port = 3260 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_host = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_login = admin {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_mount_options = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_password = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_private_key = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_share_path = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.num_shell_tries = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.quobyte_volume_url = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.replication_device = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.report_discard_supported = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.reserved_percentage = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.target_helper = tgtadm {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.target_ip_address = 192.168.122.197 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.target_port = 3260 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.target_protocol = iscsi {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.trace_flags = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.unique_fqdn_network = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.use_chap_auth = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.volume_backend_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.volume_clear = zero {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.volume_clear_ionice = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.volume_clear_size = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_reports.file_event_handler = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_reports.log_dir = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.backend_availability_zone = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.backend_host = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.chap_password = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.chap_username = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.chiscsi_conf = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.disk_geometry = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.driver_client_cert = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.driver_data_namespace = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.driver_use_ssl = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.extra_capabilities = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.filter_function = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.goodness_function = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.iser_helper = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.iser_ip_address = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.iser_port = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.iser_target_prefix = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_host = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_login = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_mount_options = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_password = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_private_key = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_share_path = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_ssh_port = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.num_shell_tries = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.nvmet_port_id = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.replication_device = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.report_discard_supported = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.reserved_percentage = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.scst_target_driver = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.storage_protocol = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.target_helper = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.target_ip_address = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.target_port = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.target_prefix = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.target_protocol = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.trace_flags = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.use_chap_auth = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.volume_clear = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.volume_clear_size = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] QuobyteHD.volumes_dir = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.ssl = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_notifications.driver = [] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_notifications.retry = -1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] key_manager.fixed_key = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.barbican_api_version = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.barbican_endpoint = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.barbican_endpoint_type = public {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.barbican_region_name = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.cafile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.certfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.collect_timing = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.insecure = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.keyfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.number_of_retries = 60 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.retry_delay = 1 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.send_service_user_token = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.split_loggers = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.timeout = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.verify_ssl = True {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican.verify_ssl_path = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican_service_user.auth_section = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican_service_user.auth_type = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican_service_user.cafile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican_service_user.certfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican_service_user.collect_timing = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican_service_user.insecure = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican_service_user.keyfile = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican_service_user.split_loggers = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] barbican_service_user.timeout = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.approle_role_id = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.approle_secret_id = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.kv_mountpoint = secret {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.kv_path = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.kv_version = 2 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.namespace = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.root_token_id = **** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.ssl_ca_crt_file = None {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.timeout = 60.0 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.use_ssl = False {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:19:12 devstack cinder-volume[86965]: DEBUG oslo_service.backend._eventlet.service [None req-564cd7a7-e78b-4c10-ab3e-fcc3658dc514 None None] ******************************************************************************** {{(pid=86965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:19:14 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.803s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:14 devstack cinder-volume[87204]: INFO cinder.volume.driver [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG cinder.volume.driver [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5856590270996, 'free_capacity_gb': 1775.5856590270996, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87204) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG oslo_db.sqlalchemy.engines [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writer thread running {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG cinder.db.api [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Building query based on filter {{(pid=87204) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87204) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:14 devstack cinder-volume[87204]: INFO cinder.keymgr.migration [None req-d0e3614d-2a74-45b7-b277-a3e964db9a13 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:19:14 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:19:14 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:15 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.998s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:19:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Driver initialization completed successfully. Jul 08 01:19:15 devstack cinder-volume[87204]: INFO cinder.manager [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Initiating service 3 cleanup Jul 08 01:19:15 devstack cinder-volume[87204]: INFO cinder.manager [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Service 3 cleanup completed. Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG cinder.service [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Creating RPC server for service cinder-volume {{(pid=87204) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG cinder.service [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87204) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:19:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:15 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:19:15 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:16 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d62c4b7d-e625-4081-960a-ab3ae5cc0283 None None] Driver post RPC initialization completed successfully. Jul 08 01:19:22 devstack cinder-volume[86965]: DEBUG dbcounter [-] [86965] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86965) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:19:25 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:19:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:19:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:19:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 6 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:19:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Flow 'volume_create_manager' (85a8f0f1-536b-469e-991d-5626a83156e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122f7aaf-9dca-4f7a-b2ce-d995e749eec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122f7aaf-9dca-4f7a-b2ce-d995e749eec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1496903569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654a0a8d-b97b-460f-8a56-9ad6f6b3fa47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce377e6a49174854ba7e63aca634fd6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:15Z,use_quota=True,user_id='a4e729cc01b045e59203d5fd3fa0ce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca032260-51af-4560-9655-1454ae75ebb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca032260-51af-4560-9655-1454ae75ebb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7e63d1-d19e-4a78-9843-14c4d00febaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7e63d1-d19e-4a78-9843-14c4d00febaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654a0a8d-b97b-460f-8a56-9ad6f6b3fa47', 'volume_name': 'volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b75a5cc-48e1-4dbf-9008-25ee638f07c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b75a5cc-48e1-4dbf-9008-25ee638f07c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6186badf-60e7-4328-8a1d-127c2ed2dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:15 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Volume 654a0a8d-b97b-460f-8a56-9ad6f6b3fa47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47', 'volume_size': 1} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1496903569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654a0a8d-b97b-460f-8a56-9ad6f6b3fa47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce377e6a49174854ba7e63aca634fd6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:15Z,use_quota=True,user_id='a4e729cc01b045e59203d5fd3fa0ce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Creating volume 654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:20:15 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:20:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:15 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 1073741824 Jul 08 01:20:15 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:16 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 1073741824" returned: 0 in 1.291s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:16 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 Jul 08 01:20:16 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:17 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47" returned: 0 in 0.916s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:20:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.269s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6186badf-60e7-4328-8a1d-127c2ed2dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6605a7-45c0-45c3-a1a9-dab2fbae9a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Volume volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 (654a0a8d-b97b-460f-8a56-9ad6f6b3fa47): created successfully Jul 08 01:20:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6605a7-45c0-45c3-a1a9-dab2fbae9a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Flow 'volume_create_manager' (85a8f0f1-536b-469e-991d-5626a83156e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1194343b-aaef-4d76-bd7f-1974c1fa005f tempest-TaggedAttachmentsTest-1938779643 None] Created volume successfully. Jul 08 01:20:27 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:20:27 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:20:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:20:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:53 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:20:53 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:55 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 2.373s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:20:56 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:20:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 6 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:20:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Flow 'volume_create_manager' (0bf1c18c-843f-4263-8b4d-4167cb9698ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef35f2cd-c51f-4587-bcbe-b2f57d2bb768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef35f2cd-c51f-4587-bcbe-b2f57d2bb768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-23596830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b985e2-fecb-4f03-9567-fa2cff1435c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a670dc6190f441a9129c334da2ddd79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:00Z,use_quota=True,user_id='59d79cba93054d85bebdd657a8278c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fccc71b-1706-43f1-8f8c-aa5608ced641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fccc71b-1706-43f1-8f8c-aa5608ced641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7acc1df-344b-4737-add6-cb7a4fd0aaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7acc1df-344b-4737-add6-cb7a4fd0aaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b985e2-fecb-4f03-9567-fa2cff1435c1', 'volume_name': 'volume-90b985e2-fecb-4f03-9567-fa2cff1435c1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770a2e9a-4537-466f-a4ae-096a8afbd0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770a2e9a-4537-466f-a4ae-096a8afbd0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69cb4be-1462-4010-b30d-8ce773f57840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Volume 90b985e2-fecb-4f03-9567-fa2cff1435c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b985e2-fecb-4f03-9567-fa2cff1435c1', 'volume_size': 1} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-23596830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b985e2-fecb-4f03-9567-fa2cff1435c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a670dc6190f441a9129c334da2ddd79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:00Z,use_quota=True,user_id='59d79cba93054d85bebdd657a8278c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Creating volume 90b985e2-fecb-4f03-9567-fa2cff1435c1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:00 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:21:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:00 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 1073741824 Jul 08 01:21:00 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:02 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 1073741824" returned: 0 in 1.910s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:02 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 Jul 08 01:21:02 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:04 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1" returned: 0 in 1.424s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] <== create_volume: return (3469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.478s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69cb4be-1462-4010-b30d-8ce773f57840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b985e2-fecb-4f03-9567-fa2cff1435c1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e0efec-6487-430d-bc05-7e167f9847d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Volume volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 (90b985e2-fecb-4f03-9567-fa2cff1435c1): created successfully Jul 08 01:21:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e0efec-6487-430d-bc05-7e167f9847d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Flow 'volume_create_manager' (0bf1c18c-843f-4263-8b4d-4167cb9698ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5f2f435b-9a16-4626-8871-dd61a78bde17 tempest-VolumesAdminNegativeTest-389052836 None] Created volume successfully. Jul 08 01:21:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Acquiring lock "cinder-90b985e2-fecb-4f03-9567-fa2cff1435c1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Lock "cinder-90b985e2-fecb-4f03-9567-fa2cff1435c1-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Acquiring lock "cinder-quobyte-90b985e2-fecb-4f03-9567-fa2cff1435c1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Lock "cinder-quobyte-90b985e2-fecb-4f03-9567-fa2cff1435c1" acquired by "delete_volume" :: waited 0.057s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:07 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2c4n3cxa/privsep.sock'] Jul 08 01:21:07 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2c4n3cxa/privsep.sock Jul 08 01:21:07 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:08 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 01:21:08 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:21:08 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 01:21:08 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:21:08 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:21:08 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 01:21:08 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:21:08 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:21:08 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 01:21:10 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 01:21:10 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:21:10 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 01:21:10 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:21:10 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:21:10 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 01:21:10 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:21:10 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:21:10 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 01:21:10 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:10 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Spawned new privsep daemon via rootwrap Jul 08 01:21:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Accepted privsep connection to /tmp/tmp2c4n3cxa/privsep.sock {{(pid=87204) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 01:21:10 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 01:21:10 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 01:21:10 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 01:21:10 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88445 Jul 08 01:21:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ce47c7-da75-40de-9f4a-129e52adf17d]: (2,) {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a8bb29-0a4b-4bb4-a087-1b8dc73157c2]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:11 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 Jul 08 01:21:11 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:12 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1" returned: 0 in 1.428s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:12 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1 Jul 08 01:21:12 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:13 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-90b985e2-fecb-4f03-9567-fa2cff1435c1" returned: 0 in 1.187s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Lock "cinder-quobyte-90b985e2-fecb-4f03-9567-fa2cff1435c1" released by "delete_volume" :: held 5.738s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:13 devstack cinder-volume[87204]: WARNING cinder.quota [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:21:13 devstack cinder-volume[87204]: WARNING cinder.quota [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:21:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Created reservations ['5e85cf55-d627-4d1c-aa38-db6fa4ec64f1', 'df9faffd-96ca-4281-9b67-7fa4119032ad', '20dc717a-e8ce-4612-9021-20549e4620cb', 'a4a1b6da-e7b9-4cb9-847e-46ebd0076f72'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:14 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:21:14 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:15 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.484s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Deleted volume successfully. Jul 08 01:21:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b4c2c62f-4c1a-42e9-a004-74215ab1a8b5 tempest-VolumesAdminNegativeTest-389052836 None] Lock "cinder-90b985e2-fecb-4f03-9567-fa2cff1435c1-delete_volume" released by "delete_volume" :: held 8.031s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:25 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:21:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=13,cinder:SELECT=8,cinder:INSERT=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Flow 'volume_create_manager' (083d936f-83b1-41ca-ab27-4faee7c91dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55aa2f0e-79fe-4b07-9aab-20f2214afd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55aa2f0e-79fe-4b07-9aab-20f2214afd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1452650078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27877b0-90e2-46f9-ac59-677ec9d1a9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c5c8329e044f7bab8ae25264a7e83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:47Z,use_quota=True,user_id='8dde44abcfc44a7daf975e29dde4ac32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdc7343-2398-4c93-8f8f-6b205a0418a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdc7343-2398-4c93-8f8f-6b205a0418a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833c9201-6671-441f-bd01-a55703633b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833c9201-6671-441f-bd01-a55703633b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd27877b0-90e2-46f9-ac59-677ec9d1a9ac', 'volume_name': 'volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090e06bd-2ae4-4ecc-b0d0-3262d5effc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090e06bd-2ae4-4ecc-b0d0-3262d5effc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0446e1-5527-48c6-a29a-00ffd800611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:47 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Volume d27877b0-90e2-46f9-ac59-677ec9d1a9ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac', 'volume_size': 1} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1452650078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27877b0-90e2-46f9-ac59-677ec9d1a9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c5c8329e044f7bab8ae25264a7e83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:47Z,use_quota=True,user_id='8dde44abcfc44a7daf975e29dde4ac32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Creating volume d27877b0-90e2-46f9-ac59-677ec9d1a9ac {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:47 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:21:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:47 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac 1073741824 Jul 08 01:21:47 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:48 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac 1073741824" returned: 0 in 1.482s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:48 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac Jul 08 01:21:48 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:49 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac" returned: 0 in 0.979s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] <== create_volume: return (2521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.525s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0446e1-5527-48c6-a29a-00ffd800611a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d9489a-30e2-424d-8c17-21aeeba984a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Volume volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac (d27877b0-90e2-46f9-ac59-677ec9d1a9ac): created successfully Jul 08 01:21:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d9489a-30e2-424d-8c17-21aeeba984a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Flow 'volume_create_manager' (083d936f-83b1-41ca-ab27-4faee7c91dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a499e325-9277-460c-a146-72af206bd115 tempest-ServersNegativeTestJSON-1187388317 None] Created volume successfully. Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Flow 'volume_create_manager' (49e90f5e-f953-472f-b364-f21a634d5042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ce6ccc-66c7-4dae-8453-af93687de366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ce6ccc-66c7-4dae-8453-af93687de366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1570144297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f261fbc91d45e8a9c92e57cdec0183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:50Z,use_quota=True,user_id='db1483e6e023428083547bb7fb883a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d24445b-bcc5-4c42-87e7-649eb78f71e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d24445b-bcc5-4c42-87e7-649eb78f71e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a31587-60ef-4e26-bfd0-e5a9b6435980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a31587-60ef-4e26-bfd0-e5a9b6435980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da', 'volume_name': 'volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cbacf5-ed2c-49e8-a794-55f30328d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cbacf5-ed2c-49e8-a794-55f30328d57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a0ddca-59b7-4be6-96ce-9912539b0ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Volume f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da', 'volume_size': 1} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1570144297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f261fbc91d45e8a9c92e57cdec0183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:50Z,use_quota=True,user_id='db1483e6e023428083547bb7fb883a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Creating volume f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:21:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:50 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da 1073741824 Jul 08 01:21:50 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:52 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da 1073741824" returned: 0 in 1.676s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:52 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da Jul 08 01:21:52 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Flow 'volume_create_manager' (985517f4-9f69-4b9b-b45e-165b7da68044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2852a7ae-8a7f-435d-9aa1-b7a4c3e07db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2852a7ae-8a7f-435d-9aa1-b7a4c3e07db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-177034272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc99b51-1407-48de-aa18-ee0555ef3b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c5c8329e044f7bab8ae25264a7e83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:53Z,use_quota=True,user_id='8dde44abcfc44a7daf975e29dde4ac32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63277de5-76fc-4031-9635-d21f8bdc277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63277de5-76fc-4031-9635-d21f8bdc277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811bbd82-2be7-4f6a-a53b-5084cda69f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811bbd82-2be7-4f6a-a53b-5084cda69f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc99b51-1407-48de-aa18-ee0555ef3b9a', 'volume_name': 'volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bc5295-7e4b-4d9c-87c3-095cd08f2cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bc5295-7e4b-4d9c-87c3-095cd08f2cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9e21fc-4109-480c-ac60-aaf636b219cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Volume 5dc99b51-1407-48de-aa18-ee0555ef3b9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a', 'volume_size': 1} Jul 08 01:21:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:53 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da" returned: 0 in 1.163s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] <== create_volume: return (2911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.915s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-177034272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc99b51-1407-48de-aa18-ee0555ef3b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c5c8329e044f7bab8ae25264a7e83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:53Z,use_quota=True,user_id='8dde44abcfc44a7daf975e29dde4ac32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Creating volume 5dc99b51-1407-48de-aa18-ee0555ef3b9a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:53 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a0ddca-59b7-4be6-96ce-9912539b0ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:53 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a 1073741824 Jul 08 01:21:53 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58be767-d984-43fa-88bf-c15934dfa702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Volume volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da (f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da): created successfully Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58be767-d984-43fa-88bf-c15934dfa702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Flow 'volume_create_manager' (49e90f5e-f953-472f-b364-f21a634d5042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-00594215-4ea6-4d97-afa8-a0a67993c616 tempest-DeleteServersTestJSON-1204326192 None] Created volume successfully. Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:53 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:21:53 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:55 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.462s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:55 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a 1073741824" returned: 0 in 2.168s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:55 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a Jul 08 01:21:55 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:56 devstack cinder-volume[87204]: WARNING py.warnings [req-da1d43fe-da5b-4a76-aa41-bb5e1a645b84 req-463e168f-9682-4527-ba86-a351a13582e2 tempest-TaggedAttachmentsTest-1938779643 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 08 01:21:56 devstack cinder-volume[87204]: .first() Jul 08 01:21:56 devstack cinder-volume[87204]: Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-da1d43fe-da5b-4a76-aa41-bb5e1a645b84 req-463e168f-9682-4527-ba86-a351a13582e2 tempest-TaggedAttachmentsTest-1938779643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:56 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a" returned: 0 in 1.140s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] <== create_volume: return (3364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.370s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-da1d43fe-da5b-4a76-aa41-bb5e1a645b84 req-463e168f-9682-4527-ba86-a351a13582e2 tempest-TaggedAttachmentsTest-1938779643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.193s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9e21fc-4109-480c-ac60-aaf636b219cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfc395c-cdef-4e39-b759-7df003bd4b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b8a62e-bd98-4049-b171-85f9c7f452e3]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-da1d43fe-da5b-4a76-aa41-bb5e1a645b84 req-463e168f-9682-4527-ba86-a351a13582e2 tempest-TaggedAttachmentsTest-1938779643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Volume volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a (5dc99b51-1407-48de-aa18-ee0555ef3b9a): created successfully Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfc395c-cdef-4e39-b759-7df003bd4b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Flow 'volume_create_manager' (985517f4-9f69-4b9b-b45e-165b7da68044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0279fca6-2a9a-4bf0-ae1f-d9401a443eb9 tempest-ServersNegativeTestJSON-1187388317 None] Created volume successfully. Jul 08 01:21:57 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 Jul 08 01:21:57 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:58 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-da1d43fe-da5b-4a76-aa41-bb5e1a645b84 req-463e168f-9682-4527-ba86-a351a13582e2 tempest-TaggedAttachmentsTest-1938779643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47" returned: 0 in 1.377s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-da1d43fe-da5b-4a76-aa41-bb5e1a645b84 req-463e168f-9682-4527-ba86-a351a13582e2 tempest-TaggedAttachmentsTest-1938779643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.434s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-da1d43fe-da5b-4a76-aa41-bb5e1a645b84 req-463e168f-9682-4527-ba86-a351a13582e2 tempest-TaggedAttachmentsTest-1938779643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0dc11d9-c5da-4496-9dc9-cb9a4edaaaa7', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-5e86300b-2ae7-483e-b94b-fe31d13b5fe1 req-3ed92eb2-aa43-4111-a214-36db9ab6d776 tempest-DeleteServersTestJSON-1204326192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-5e86300b-2ae7-483e-b94b-fe31d13b5fe1 req-3ed92eb2-aa43-4111-a214-36db9ab6d776 tempest-DeleteServersTestJSON-1204326192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4485cfd3-b260-410c-ade3-0e72a706e147]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5e86300b-2ae7-483e-b94b-fe31d13b5fe1 req-3ed92eb2-aa43-4111-a214-36db9ab6d776 tempest-DeleteServersTestJSON-1204326192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-da1d43fe-da5b-4a76-aa41-bb5e1a645b84 req-463e168f-9682-4527-ba86-a351a13582e2 tempest-TaggedAttachmentsTest-1938779643 None] attachment_update completed successfully. Jul 08 01:21:58 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da Jul 08 01:21:58 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "cinder-5dc99b51-1407-48de-aa18-ee0555ef3b9a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Lock "cinder-5dc99b51-1407-48de-aa18-ee0555ef3b9a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "cinder-quobyte-5dc99b51-1407-48de-aa18-ee0555ef3b9a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Lock "cinder-quobyte-5dc99b51-1407-48de-aa18-ee0555ef3b9a" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[355c9736-3b56-453b-8ddb-ac521b04f44a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:59 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a Jul 08 01:21:59 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:59 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5e86300b-2ae7-483e-b94b-fe31d13b5fe1 req-3ed92eb2-aa43-4111-a214-36db9ab6d776 tempest-DeleteServersTestJSON-1204326192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da" returned: 0 in 1.396s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-5e86300b-2ae7-483e-b94b-fe31d13b5fe1 req-3ed92eb2-aa43-4111-a214-36db9ab6d776 tempest-DeleteServersTestJSON-1204326192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.428s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-5e86300b-2ae7-483e-b94b-fe31d13b5fe1 req-3ed92eb2-aa43-4111-a214-36db9ab6d776 tempest-DeleteServersTestJSON-1204326192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0a55402-d335-493c-aa05-a2b80de8f9e0', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:22:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-5e86300b-2ae7-483e-b94b-fe31d13b5fe1 req-3ed92eb2-aa43-4111-a214-36db9ab6d776 tempest-DeleteServersTestJSON-1204326192 None] attachment_update completed successfully. Jul 08 01:22:00 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a" returned: 0 in 1.300s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:00 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a Jul 08 01:22:00 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:01 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5dc99b51-1407-48de-aa18-ee0555ef3b9a" returned: 0 in 0.947s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Lock "cinder-quobyte-5dc99b51-1407-48de-aa18-ee0555ef3b9a" released by "delete_volume" :: held 2.388s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:01 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Created reservations ['8a6ae4ab-608b-4675-8904-f40b8c4fb63e', 'd03cbc23-5c5c-4bf4-97b4-ee009f0dabb2', '10c01911-4f14-410c-81dc-82f234f434de', 'c455a26e-4c66-4abe-95bb-6c1118d51792'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:01 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:22:01 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:02 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.916s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:02 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Deleted volume successfully. Jul 08 01:22:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c02ef2e9-8026-45d9-a4d7-77677a97fe0e tempest-ServersNegativeTestJSON-1187388317 None] Lock "cinder-5dc99b51-1407-48de-aa18-ee0555ef3b9a-delete_volume" released by "delete_volume" :: held 3.683s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "cinder-d27877b0-90e2-46f9-ac59-677ec9d1a9ac-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Lock "cinder-d27877b0-90e2-46f9-ac59-677ec9d1a9ac-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "cinder-quobyte-d27877b0-90e2-46f9-ac59-677ec9d1a9ac" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Lock "cinder-quobyte-d27877b0-90e2-46f9-ac59-677ec9d1a9ac" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c3a52f-4c66-49c1-8f76-fd7f9d7131e8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:02 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac Jul 08 01:22:02 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:04 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac" returned: 0 in 1.344s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:04 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac Jul 08 01:22:04 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:05 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d27877b0-90e2-46f9-ac59-677ec9d1a9ac" returned: 0 in 1.230s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Lock "cinder-quobyte-d27877b0-90e2-46f9-ac59-677ec9d1a9ac" released by "delete_volume" :: held 2.667s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Created reservations ['4dece3c0-6ec6-4dcf-9db2-d7587f6e2193', 'edf24f3e-a313-4198-800c-ad27f320b73f', '1481b618-a909-4bf0-be02-ed37330cfb6a', '78962d2a-7d4a-4aeb-85c3-7e90a38e9633'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:05 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:22:05 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:06 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.133s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:06 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Deleted volume successfully. Jul 08 01:22:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fa602a65-add9-44e1-8f82-52097a865c7a tempest-ServersNegativeTestJSON-1187388317 None] Lock "cinder-d27877b0-90e2-46f9-ac59-677ec9d1a9ac-delete_volume" released by "delete_volume" :: held 4.207s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-6be5289c-31d1-4e56-9bac-ebbb686ce5d0 req-1ea2500c-5db7-4c52-865e-7e8ee0c130c9 tempest-TaggedAttachmentsTest-1938779643 None] Terminate volume connection completed successfully. Jul 08 01:22:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-6be5289c-31d1-4e56-9bac-ebbb686ce5d0 req-1ea2500c-5db7-4c52-865e-7e8ee0c130c9 tempest-TaggedAttachmentsTest-1938779643 None] Deleting attachment d0dc11d9-c5da-4496-9dc9-cb9a4edaaaa7. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:22:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-dfc300dd-759a-4eed-8cbc-bc31259394c1 req-4c909f33-d02a-4017-823a-6e8cc0ef7dc2 tempest-DeleteServersTestJSON-1204326192 None] Terminate volume connection completed successfully. Jul 08 01:22:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-dfc300dd-759a-4eed-8cbc-bc31259394c1 req-4c909f33-d02a-4017-823a-6e8cc0ef7dc2 tempest-DeleteServersTestJSON-1204326192 None] Deleting attachment f0a55402-d335-493c-aa05-a2b80de8f9e0. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:22:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Acquiring lock "cinder-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Lock "cinder-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Acquiring lock "cinder-quobyte-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Lock "cinder-quobyte-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[58695891-32e4-410c-ab75-4d00e5aa5ce9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:14 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da Jul 08 01:22:14 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:15 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:15 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da Jul 08 01:22:15 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:16 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Lock "cinder-quobyte-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da" released by "delete_volume" :: held 1.741s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:16 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Created reservations ['130cc169-9e2a-4353-a704-7cbb91e2bd6a', '9d55721c-2a05-4dfd-9723-33bdfd9159e2', 'fe641740-33e6-474a-b224-aff5041863ac', 'd77b84d3-1681-4e7a-a523-8d1ba2f5fa42'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:16 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:22:16 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:17 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.085s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:17 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Deleted volume successfully. Jul 08 01:22:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-00e4629e-399b-4f6a-bd0a-1f4955d4d530 tempest-DeleteServersTestJSON-1204326192 None] Lock "cinder-f74c5ae3-889e-4ee4-9dd7-a75d0c3b73da-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=32,cinder:SELECT=37,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:27 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=31,cinder:UPDATE=40,cinder:DELETE=5,cinder:INSERT=5 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Acquiring lock "cinder-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Lock "cinder-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Acquiring lock "cinder-quobyte-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Lock "cinder-quobyte-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd24ba2f-1d95-4444-b372-89d92e20143f]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:38 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 Jul 08 01:22:38 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:39 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47" returned: 0 in 1.452s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:39 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47 Jul 08 01:22:39 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:40 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47" returned: 0 in 1.163s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Lock "cinder-quobyte-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47" released by "delete_volume" :: held 2.727s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:40 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Created reservations ['9c4addc5-0ae3-4df8-8b7f-bd2249a357a2', '418e6303-52c0-485d-a02e-50c11762f2d3', '5827be35-c5c5-40b7-b5b4-171e148a4958', 'fe711952-4eb2-4064-bf0c-faaaf518ffb3'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:41 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:22:41 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:42 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.127s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:42 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Deleted volume successfully. Jul 08 01:22:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f79c76-50c9-4025-b089-76c446c6c3ce tempest-TaggedAttachmentsTest-1938779643 None] Lock "cinder-654a0a8d-b97b-460f-8a56-9ad6f6b3fa47-delete_volume" released by "delete_volume" :: held 4.369s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:50 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=9,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Flow 'volume_create_manager' (c50a8fad-5e66-4179-9cd1-11622d5c2157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff63459d-95c6-48a5-b48a-8f0f2d3280d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff63459d-95c6-48a5-b48a-8f0f2d3280d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1674017757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a7d5ec-5057-4352-952d-c707fb293503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8049ad2560114639a8b0cbfd4577568f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:52Z,use_quota=True,user_id='61122e7f7cd34bb0a0963464d0e3ba1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962ff0d-40b4-47c7-84c2-51f5164150c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962ff0d-40b4-47c7-84c2-51f5164150c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e440cd8-b2b3-45e4-93eb-4fbaa364ac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e440cd8-b2b3-45e4-93eb-4fbaa364ac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a7d5ec-5057-4352-952d-c707fb293503', 'volume_name': 'volume-c5a7d5ec-5057-4352-952d-c707fb293503', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef726c3-981a-4d54-beea-0d13bf4df32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef726c3-981a-4d54-beea-0d13bf4df32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8467ab7c-2583-4f2a-b434-12abf26d5be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Volume c5a7d5ec-5057-4352-952d-c707fb293503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a7d5ec-5057-4352-952d-c707fb293503', 'volume_size': 1} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1674017757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a7d5ec-5057-4352-952d-c707fb293503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8049ad2560114639a8b0cbfd4577568f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:52Z,use_quota=True,user_id='61122e7f7cd34bb0a0963464d0e3ba1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Creating volume c5a7d5ec-5057-4352-952d-c707fb293503 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:52 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:22:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:52 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 1073741824 Jul 08 01:22:52 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:22:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:53 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:22:53 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:53 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 1073741824" returned: 0 in 1.274s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:53 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 Jul 08 01:22:53 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:54 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503" returned: 0 in 0.996s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] <== create_volume: return (2339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.350s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:54 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.223s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8467ab7c-2583-4f2a-b434-12abf26d5be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a7d5ec-5057-4352-952d-c707fb293503', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d68b224-8394-43ce-86be-255be7ac7602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Volume volume-c5a7d5ec-5057-4352-952d-c707fb293503 (c5a7d5ec-5057-4352-952d-c707fb293503): created successfully Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d68b224-8394-43ce-86be-255be7ac7602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Flow 'volume_create_manager' (c50a8fad-5e66-4179-9cd1-11622d5c2157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2f84d7a4-057b-4ac1-a4b5-73351e6b47cc tempest-AttachVolumeTestJSON-19192547 None] Created volume successfully. Jul 08 01:22:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df0176d6-c076-4a79-9e2b-bb1200738336 req-5c84e6e5-7826-4e92-8117-b6ad9f8fbcce tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df0176d6-c076-4a79-9e2b-bb1200738336 req-5c84e6e5-7826-4e92-8117-b6ad9f8fbcce tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dc0c02-47d0-48c5-a126-e100a4b8d390]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df0176d6-c076-4a79-9e2b-bb1200738336 req-5c84e6e5-7826-4e92-8117-b6ad9f8fbcce tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:59 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 Jul 08 01:22:59 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:00 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df0176d6-c076-4a79-9e2b-bb1200738336 req-5c84e6e5-7826-4e92-8117-b6ad9f8fbcce tempest-AttachVolumeTestJSON-19192547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503" returned: 0 in 1.357s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df0176d6-c076-4a79-9e2b-bb1200738336 req-5c84e6e5-7826-4e92-8117-b6ad9f8fbcce tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.401s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df0176d6-c076-4a79-9e2b-bb1200738336 req-5c84e6e5-7826-4e92-8117-b6ad9f8fbcce tempest-AttachVolumeTestJSON-19192547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-c5a7d5ec-5057-4352-952d-c707fb293503', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '762f5e80-530d-43cc-8941-4a8121b853c0', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:23:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-df0176d6-c076-4a79-9e2b-bb1200738336 req-5c84e6e5-7826-4e92-8117-b6ad9f8fbcce tempest-AttachVolumeTestJSON-19192547 None] attachment_update completed successfully. Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Flow 'volume_create_manager' (0910f836-633f-4e1d-85a4-d5a4f6df5bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62411f6f-66cb-4783-a420-745218b6a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62411f6f-66cb-4783-a420-745218b6a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1537690271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb0ec3-dfed-4f06-b4dd-881d894c01b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1eea360a1524f0baf5ac932f928e61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:03Z,use_quota=True,user_id='b6f22839a3ab4fb5aed5828e4b06efc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df73b5d-a9d1-4b77-85a6-4fb9d6e81ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df73b5d-a9d1-4b77-85a6-4fb9d6e81ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db51f1d-81e7-46d7-aeba-4d9ff4eadd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db51f1d-81e7-46d7-aeba-4d9ff4eadd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cb0ec3-dfed-4f06-b4dd-881d894c01b5', 'volume_name': 'volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f109c4-0990-4ba7-8d28-0a9a4cf41966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f109c4-0990-4ba7-8d28-0a9a4cf41966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b96e09-619d-4dc7-833f-a1bb1952720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Volume e9cb0ec3-dfed-4f06-b4dd-881d894c01b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5', 'volume_size': 1} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1537690271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb0ec3-dfed-4f06-b4dd-881d894c01b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1eea360a1524f0baf5ac932f928e61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:03Z,use_quota=True,user_id='b6f22839a3ab4fb5aed5828e4b06efc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Creating volume e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:03 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:23:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:03 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 1073741824 Jul 08 01:23:03 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:04 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 1073741824" returned: 0 in 1.157s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:04 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 Jul 08 01:23:04 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:05 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b96e09-619d-4dc7-833f-a1bb1952720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1545dc85-5aa8-4643-8c28-896c4b104f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Volume volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 (e9cb0ec3-dfed-4f06-b4dd-881d894c01b5): created successfully Jul 08 01:23:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1545dc85-5aa8-4643-8c28-896c4b104f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Flow 'volume_create_manager' (0910f836-633f-4e1d-85a4-d5a4f6df5bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-027055f7-8a29-4098-b54f-a8ab769c2b85 req-78ce2771-87ad-4d6e-8a87-92cf3f4364af tempest-VolumesGetTestJSON-1592031328 None] Created volume successfully. Jul 08 01:23:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Acquiring lock "cinder-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Lock "cinder-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Acquiring lock "cinder-quobyte-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Lock "cinder-quobyte-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[db34172a-f387-44f2-8b78-5f6f661731e9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:07 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 Jul 08 01:23:07 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:09 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5" returned: 0 in 1.708s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:09 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5 Jul 08 01:23:09 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:10 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5" returned: 0 in 1.119s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Lock "cinder-quobyte-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5" released by "delete_volume" :: held 2.947s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:10 devstack cinder-volume[87204]: DEBUG cinder.quota [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Created reservations ['e91a9245-bf91-41fd-a7b0-bc8748e88ddc', 'a75d2b8b-c8e9-46f5-97ec-3c8342cfcae9', 'cca77af6-c597-4bdf-b3f5-0b6586e6d618', 'f08a90bc-3619-465f-bfb0-8a5d2b3dc9fd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:10 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:23:10 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:12 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 2.218s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:12 devstack cinder-volume[87204]: DEBUG cinder.manager [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Deleted volume successfully. Jul 08 01:23:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-07176e98-68ec-4388-9ce8-63d26b8de36b req-a30d4d87-78a5-43b7-9695-7fbb3cb91122 tempest-VolumesGetTestJSON-1592031328 None] Lock "cinder-e9cb0ec3-dfed-4f06-b4dd-881d894c01b5-delete_volume" released by "delete_volume" :: held 5.867s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=14,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:23:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=16,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:23:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3aa3be75-5739-42f1-a439-c65653d19e0b tempest-GroupsV320Test-912274875 None] Group tempest-GroupsV320Test-Group-1978578721: creating Jul 08 01:23:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3aa3be75-5739-42f1-a439-c65653d19e0b tempest-GroupsV320Test-912274875 None] Group tempest-GroupsV320Test-Group-1978578721: created successfully Jul 08 01:23:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3aa3be75-5739-42f1-a439-c65653d19e0b tempest-GroupsV320Test-912274875 None] Create group completed successfully. Jul 08 01:23:29 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] Created reservations ['0e0b87fa-9cb4-4083-8b6f-a230b129f1df'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:29 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:23:29 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:30 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.769s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:30 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8440bd35-f119-4fba-a216-847047d976c5 tempest-GroupsV320Test-912274875 None] Delete group completed successfully. Jul 08 01:23:38 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Flow 'volume_create_manager' (6dabb70d-0cc5-480e-8822-766d98fcdd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b975ee18-dc97-4b2c-a12b-172f3d4c646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b975ee18-dc97-4b2c-a12b-172f3d4c646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1404518075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b22d1a-5262-49db-af0c-9d94660f292c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5e601959bf4b2594f4dc2ee2187f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='b2e1aa9923854c338126db2614c38c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c350b27c-8952-457c-8692-9a01ea2fef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c350b27c-8952-457c-8692-9a01ea2fef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4a4255-844a-43d9-8ec0-1b05ebf3763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4a4255-844a-43d9-8ec0-1b05ebf3763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b22d1a-5262-49db-af0c-9d94660f292c', 'volume_name': 'volume-b8b22d1a-5262-49db-af0c-9d94660f292c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5f7435-0d2b-4563-bfb5-b56e18b27e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5f7435-0d2b-4563-bfb5-b56e18b27e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3206e90-20b8-43cc-bb34-6f3be8ffc046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Volume b8b22d1a-5262-49db-af0c-9d94660f292c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b22d1a-5262-49db-af0c-9d94660f292c', 'volume_size': 1} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1404518075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b22d1a-5262-49db-af0c-9d94660f292c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5e601959bf4b2594f4dc2ee2187f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='b2e1aa9923854c338126db2614c38c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Creating volume b8b22d1a-5262-49db-af0c-9d94660f292c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:39 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:39 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c 1073741824 Jul 08 01:23:39 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Flow 'volume_create_manager' (25ebe43d-a63f-444e-85fa-d8014735c4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38664c4-9f64-4c4c-8fe8-23de75bd726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38664c4-9f64-4c4c-8fe8-23de75bd726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-209861665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69407d62-9ce8-4797-89eb-1502dcef975d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e9e6ae08ce4a718e5ae765e6c2ac2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='c7632b2b165f48d397d6eeab78f0687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7eb98a-ff87-434f-95e1-93f3f4f14698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7eb98a-ff87-434f-95e1-93f3f4f14698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7141f0f5-a05c-4f89-a916-855346d2c097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7141f0f5-a05c-4f89-a916-855346d2c097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69407d62-9ce8-4797-89eb-1502dcef975d', 'volume_name': 'volume-69407d62-9ce8-4797-89eb-1502dcef975d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233a1b0c-8e7b-4fb3-9d46-014344602891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233a1b0c-8e7b-4fb3-9d46-014344602891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380c6877-715d-4525-9fda-ae1a2dc18c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Volume 69407d62-9ce8-4797-89eb-1502dcef975d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69407d62-9ce8-4797-89eb-1502dcef975d', 'volume_size': 1} Jul 08 01:23:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:40 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c 1073741824" returned: 0 in 1.613s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:40 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c Jul 08 01:23:40 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:41 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c" returned: 0 in 1.089s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] <== create_volume: return (2793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.797s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.297s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-209861665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69407d62-9ce8-4797-89eb-1502dcef975d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e9e6ae08ce4a718e5ae765e6c2ac2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='c7632b2b165f48d397d6eeab78f0687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Creating volume 69407d62-9ce8-4797-89eb-1502dcef975d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:41 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:23:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3206e90-20b8-43cc-bb34-6f3be8ffc046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b22d1a-5262-49db-af0c-9d94660f292c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:42 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d 1073741824 Jul 08 01:23:42 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3aaca54-ea0a-4852-8f3d-299ad8681ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:42 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Volume volume-b8b22d1a-5262-49db-af0c-9d94660f292c (b8b22d1a-5262-49db-af0c-9d94660f292c): created successfully Jul 08 01:23:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3aaca54-ea0a-4852-8f3d-299ad8681ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Flow 'volume_create_manager' (6dabb70d-0cc5-480e-8822-766d98fcdd7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8948fcd2-7eab-48e0-9b7a-be218a5aef2f tempest-ServerActionsTestOtherA-2089378909 None] Created volume successfully. Jul 08 01:23:43 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d 1073741824" returned: 0 in 1.337s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:43 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d Jul 08 01:23:43 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:44 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d" returned: 0 in 0.907s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380c6877-715d-4525-9fda-ae1a2dc18c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69407d62-9ce8-4797-89eb-1502dcef975d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb2aac-ac9b-4e30-a20a-a9a6b0ab2da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Volume volume-69407d62-9ce8-4797-89eb-1502dcef975d (69407d62-9ce8-4797-89eb-1502dcef975d): created successfully Jul 08 01:23:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb2aac-ac9b-4e30-a20a-a9a6b0ab2da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Flow 'volume_create_manager' (25ebe43d-a63f-444e-85fa-d8014735c4ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1d23f4a5-c2d3-48cf-82e9-b5d329cc322b tempest-AttachVolumeNegativeTest-1709776555 None] Created volume successfully. Jul 08 01:23:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-cd61ec1b-9f87-4837-9f15-4afd9065ce63 req-386a208d-2dc4-4da6-9bad-ab0e9229c877 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-cd61ec1b-9f87-4837-9f15-4afd9065ce63 req-386a208d-2dc4-4da6-9bad-ab0e9229c877 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1eaac0-2acd-4f6a-b82c-695a986e7b1c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-cd61ec1b-9f87-4837-9f15-4afd9065ce63 req-386a208d-2dc4-4da6-9bad-ab0e9229c877 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:47 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d Jul 08 01:23:47 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:48 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-cd61ec1b-9f87-4837-9f15-4afd9065ce63 req-386a208d-2dc4-4da6-9bad-ab0e9229c877 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d" returned: 0 in 0.857s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-cd61ec1b-9f87-4837-9f15-4afd9065ce63 req-386a208d-2dc4-4da6-9bad-ab0e9229c877 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-cd61ec1b-9f87-4837-9f15-4afd9065ce63 req-386a208d-2dc4-4da6-9bad-ab0e9229c877 tempest-AttachVolumeNegativeTest-1709776555 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-69407d62-9ce8-4797-89eb-1502dcef975d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8893e08a-6c70-43ac-acb3-2160e8ddb0f4', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:23:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-cd61ec1b-9f87-4837-9f15-4afd9065ce63 req-386a208d-2dc4-4da6-9bad-ab0e9229c877 tempest-AttachVolumeNegativeTest-1709776555 None] attachment_update completed successfully. Jul 08 01:23:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-7c3e52f1-ebfb-45fe-bfbb-472c274701a5 req-a2dd8c1d-3f88-4b9b-aa87-cf6bc2258e28 tempest-AttachVolumeTestJSON-19192547 None] Terminate volume connection completed successfully. Jul 08 01:23:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-7c3e52f1-ebfb-45fe-bfbb-472c274701a5 req-a2dd8c1d-3f88-4b9b-aa87-cf6bc2258e28 tempest-AttachVolumeTestJSON-19192547 None] Deleting attachment 762f5e80-530d-43cc-8941-4a8121b853c0. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:23:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:23:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:53 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:23:53 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:54 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.054s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:23:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:23:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:23:58 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:02 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=19,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Flow 'volume_create_manager' (039bb9b9-45e3-4ca3-a9a9-997dc8bba5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee62879a-57a9-4a0a-848a-989124a8bdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee62879a-57a9-4a0a-848a-989124a8bdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1081651890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec5e621-429c-4666-af4a-aaef7cc14440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfd8596c6d04afbb73d20fceb0babf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:13Z,use_quota=True,user_id='2910c046d3ba42feaecbea1db3faa3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac2a5e4-1c95-4e63-a744-180483630d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac2a5e4-1c95-4e63-a744-180483630d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb744fc-f0b6-4bf8-9061-894064af7c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb744fc-f0b6-4bf8-9061-894064af7c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec5e621-429c-4666-af4a-aaef7cc14440', 'volume_name': 'volume-aec5e621-429c-4666-af4a-aaef7cc14440', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5ea94a-abe9-4d39-b7f4-d87c4c3313cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5ea94a-abe9-4d39-b7f4-d87c4c3313cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415e2e25-a3d9-4f50-b88f-07596cf54def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Volume aec5e621-429c-4666-af4a-aaef7cc14440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec5e621-429c-4666-af4a-aaef7cc14440', 'volume_size': 1} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1081651890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec5e621-429c-4666-af4a-aaef7cc14440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfd8596c6d04afbb73d20fceb0babf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:13Z,use_quota=True,user_id='2910c046d3ba42feaecbea1db3faa3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Creating volume aec5e621-429c-4666-af4a-aaef7cc14440 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:13 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:24:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:13 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440 1073741824 Jul 08 01:24:13 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:14 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440 1073741824" returned: 0 in 1.099s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:14 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440 Jul 08 01:24:14 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:15 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.135s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415e2e25-a3d9-4f50-b88f-07596cf54def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec5e621-429c-4666-af4a-aaef7cc14440', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c9a270-be8a-4505-a556-6ba823fb11c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:15 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Volume volume-aec5e621-429c-4666-af4a-aaef7cc14440 (aec5e621-429c-4666-af4a-aaef7cc14440): created successfully Jul 08 01:24:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c9a270-be8a-4505-a556-6ba823fb11c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Flow 'volume_create_manager' (039bb9b9-45e3-4ca3-a9a9-997dc8bba5c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-edb24ef1-defe-4be1-8d17-27b27ecc4ca1 tempest-VolumesServicesTestJSON-877966545 None] Created volume successfully. Jul 08 01:24:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Acquiring lock "cinder-aec5e621-429c-4666-af4a-aaef7cc14440-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Lock "cinder-aec5e621-429c-4666-af4a-aaef7cc14440-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Acquiring lock "cinder-quobyte-aec5e621-429c-4666-af4a-aaef7cc14440" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Lock "cinder-quobyte-aec5e621-429c-4666-af4a-aaef7cc14440" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a207f4-58b2-4378-a624-c85f6ffaa7ea]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:17 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440 Jul 08 01:24:17 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:18 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440" returned: 0 in 1.068s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:18 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440 Jul 08 01:24:18 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:19 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aec5e621-429c-4666-af4a-aaef7cc14440" returned: 0 in 0.975s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Lock "cinder-quobyte-aec5e621-429c-4666-af4a-aaef7cc14440" released by "delete_volume" :: held 2.145s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:19 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Created reservations ['24bd9c2d-e771-4885-8ecb-349fa878552a', 'e5a2af6f-2bf4-4bfb-a1c2-67efe6036ec9', '2069b572-7042-49dc-a7d6-90e816b1b0e3', 'a843640b-ca1b-4276-9b06-ed43261983ae'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:19 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:24:19 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:21 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.881s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:21 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Deleted volume successfully. Jul 08 01:24:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08532998-e0e8-4b09-823a-e371b58187b7 tempest-VolumesServicesTestJSON-877966545 None] Lock "cinder-aec5e621-429c-4666-af4a-aaef7cc14440-delete_volume" released by "delete_volume" :: held 4.583s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d14d55ca-2ba3-4dc4-956a-bea82f7a0435 req-0f5d37c2-93ca-4187-93b3-6f38c0b59ac7 tempest-ServerActionsTestOtherA-2089378909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d14d55ca-2ba3-4dc4-956a-bea82f7a0435 req-0f5d37c2-93ca-4187-93b3-6f38c0b59ac7 tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ac74d8-5c64-4476-92af-19a505eb52c5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d14d55ca-2ba3-4dc4-956a-bea82f7a0435 req-0f5d37c2-93ca-4187-93b3-6f38c0b59ac7 tempest-ServerActionsTestOtherA-2089378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:29 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c Jul 08 01:24:29 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:29 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Flow 'volume_create_manager' (0ecbc168-435a-476a-80ce-e094ca402cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d540b390-2b14-448e-bce7-836ad5b6b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d540b390-2b14-448e-bce7-836ad5b6b493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2090650050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ccccf95a9241799c16c47e8413127c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:30Z,use_quota=True,user_id='0877718012c54def9c39a949b36cd0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1cd4a70-93e8-46f8-95ed-6f8168e7908c),volume_type_id=d1cd4a70-93e8-46f8-95ed-6f8168e7908c)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084a3eeb-5d49-4e0b-b110-c3ac34760a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084a3eeb-5d49-4e0b-b110-c3ac34760a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2212240e-586b-4083-9101-981d94a56b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2212240e-586b-4083-9101-981d94a56b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1', 'volume_name': 'volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105469c2-3348-4e83-88c1-0a37ef3e0299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105469c2-3348-4e83-88c1-0a37ef3e0299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968b1eff-0c3a-460e-808f-fee8c56df468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Volume d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1', 'volume_size': 1} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:30 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d14d55ca-2ba3-4dc4-956a-bea82f7a0435 req-0f5d37c2-93ca-4187-93b3-6f38c0b59ac7 tempest-ServerActionsTestOtherA-2089378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c" returned: 0 in 1.029s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d14d55ca-2ba3-4dc4-956a-bea82f7a0435 req-0f5d37c2-93ca-4187-93b3-6f38c0b59ac7 tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.052s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.118s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2090650050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ccccf95a9241799c16c47e8413127c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:30Z,use_quota=True,user_id='0877718012c54def9c39a949b36cd0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1cd4a70-93e8-46f8-95ed-6f8168e7908c),volume_type_id=d1cd4a70-93e8-46f8-95ed-6f8168e7908c)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Creating volume d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:30 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:30 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 1073741824 Jul 08 01:24:30 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-d14d55ca-2ba3-4dc4-956a-bea82f7a0435 req-0f5d37c2-93ca-4187-93b3-6f38c0b59ac7 tempest-ServerActionsTestOtherA-2089378909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-b8b22d1a-5262-49db-af0c-9d94660f292c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a13ed2d4-ddad-4629-a76e-4afeedcb42dd', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:24:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-d14d55ca-2ba3-4dc4-956a-bea82f7a0435 req-0f5d37c2-93ca-4187-93b3-6f38c0b59ac7 tempest-ServerActionsTestOtherA-2089378909 None] attachment_update completed successfully. Jul 08 01:24:31 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 1073741824" returned: 0 in 1.146s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:31 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 Jul 08 01:24:31 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:32 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1" returned: 0 in 0.896s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968b1eff-0c3a-460e-808f-fee8c56df468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e3ae54-d987-4531-9b4e-3c570d134ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Volume volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 (d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1): created successfully Jul 08 01:24:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e3ae54-d987-4531-9b4e-3c570d134ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Flow 'volume_create_manager' (0ecbc168-435a-476a-80ce-e094ca402cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-34fd4282-0dde-4281-b9e2-7b2b559b7d46 tempest-VolumeTypesAccessTest-2041156322 None] Created volume successfully. Jul 08 01:24:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Acquiring lock "cinder-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Lock "cinder-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Acquiring lock "cinder-quobyte-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Lock "cinder-quobyte-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1138ba9-8792-47a0-947c-f3dc62607941]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:33 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 Jul 08 01:24:33 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:34 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1" returned: 0 in 1.071s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:34 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1 Jul 08 01:24:34 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:35 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1" returned: 0 in 0.875s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Lock "cinder-quobyte-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1" released by "delete_volume" :: held 2.039s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:35 devstack cinder-volume[87204]: WARNING cinder.quota [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1246306947 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1246306947, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:24:35 devstack cinder-volume[87204]: WARNING cinder.quota [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1246306947 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1246306947, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:24:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Created reservations ['2bbe487f-b59e-437c-9eef-0332a172469b', '106bc187-5e6b-4dee-b650-1cda0a84051e', '59ec8d01-91f8-4c2c-81f8-226c9c9376d3', 'c911b427-4801-4a3c-8a01-4131790942d2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:35 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:24:35 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:36 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.854s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:36 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Deleted volume successfully. Jul 08 01:24:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-293ed460-d18e-4b93-8c8f-12ead9c7c654 tempest-VolumeTypesAccessTest-2041156322 None] Lock "cinder-d8d56c2d-b6d2-4b27-b4cf-fa52d9ba29b1-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-06f7d155-304e-4639-849a-688898ba7f5e req-3e5d3c1b-6e22-47b8-97c1-d7477ac73ec8 tempest-ServerActionsTestOtherA-2089378909 None] Terminate volume connection completed successfully. Jul 08 01:24:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-06f7d155-304e-4639-849a-688898ba7f5e req-3e5d3c1b-6e22-47b8-97c1-d7477ac73ec8 tempest-ServerActionsTestOtherA-2089378909 None] Deleting attachment a13ed2d4-ddad-4629-a76e-4afeedcb42dd. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:24:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-06f7d155-304e-4639-849a-688898ba7f5e req-1aa0cc56-0130-4042-a6d5-9aba06a23eb1 tempest-ServerActionsTestOtherA-2089378909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-06f7d155-304e-4639-849a-688898ba7f5e req-1aa0cc56-0130-4042-a6d5-9aba06a23eb1 tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba3d238-8aef-45de-87ba-c816703403a0]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-06f7d155-304e-4639-849a-688898ba7f5e req-1aa0cc56-0130-4042-a6d5-9aba06a23eb1 tempest-ServerActionsTestOtherA-2089378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:42 devstack sudo[91597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c Jul 08 01:24:42 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:43 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-06f7d155-304e-4639-849a-688898ba7f5e req-1aa0cc56-0130-4042-a6d5-9aba06a23eb1 tempest-ServerActionsTestOtherA-2089378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c" returned: 0 in 1.092s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-06f7d155-304e-4639-849a-688898ba7f5e req-1aa0cc56-0130-4042-a6d5-9aba06a23eb1 tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.124s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-06f7d155-304e-4639-849a-688898ba7f5e req-1aa0cc56-0130-4042-a6d5-9aba06a23eb1 tempest-ServerActionsTestOtherA-2089378909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-b8b22d1a-5262-49db-af0c-9d94660f292c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efb6a6b9-74e5-4f0d-adb8-e17feb6a9509', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:24:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-06f7d155-304e-4639-849a-688898ba7f5e req-1aa0cc56-0130-4042-a6d5-9aba06a23eb1 tempest-ServerActionsTestOtherA-2089378909 None] attachment_update completed successfully. Jul 08 01:24:53 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=30,cinder:UPDATE=26,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:53 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:24:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:53 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:24:53 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:54 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.087s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:24:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:24:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:24:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-b7216080-cc86-44c6-b8e5-d51dd6084928 req-e38325fb-b8d8-4876-a808-1043dd883158 tempest-AttachVolumeNegativeTest-1709776555 None] Terminate volume connection completed successfully. Jul 08 01:24:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-b7216080-cc86-44c6-b8e5-d51dd6084928 req-e38325fb-b8d8-4876-a808-1043dd883158 tempest-AttachVolumeNegativeTest-1709776555 None] Deleting attachment 8893e08a-6c70-43ac-acb3-2160e8ddb0f4. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Flow 'volume_create_manager' (7cb86246-e6f4-4320-9b7b-232bdf84ec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8464cbbd-fc3f-4362-81e0-d66e91283902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8464cbbd-fc3f-4362-81e0-d66e91283902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1255856261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce146977-9b3f-4ae0-adbb-c0180cbfddc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8e36150a4945be9ef94256e2919c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:02Z,use_quota=True,user_id='17604b23b77242ac8a8b524fe2e128fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14819cf7-7e3b-4cae-a760-478ec2db7a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14819cf7-7e3b-4cae-a760-478ec2db7a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126dc266-3938-4f64-a116-2d9fbcfc895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126dc266-3938-4f64-a116-2d9fbcfc895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce146977-9b3f-4ae0-adbb-c0180cbfddc2', 'volume_name': 'volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfff084b-9d0f-44c9-a3c5-3b6e35bf625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfff084b-9d0f-44c9-a3c5-3b6e35bf625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8b18f3-ae43-4061-b18f-4635e101d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Volume ce146977-9b3f-4ae0-adbb-c0180cbfddc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2', 'volume_size': 1} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1255856261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce146977-9b3f-4ae0-adbb-c0180cbfddc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8e36150a4945be9ef94256e2919c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:02Z,use_quota=True,user_id='17604b23b77242ac8a8b524fe2e128fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Creating volume ce146977-9b3f-4ae0-adbb-c0180cbfddc2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:01 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:25:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:01 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 1073741824 Jul 08 01:25:02 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:03 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 1073741824" returned: 0 in 1.402s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:03 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 Jul 08 01:25:03 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:04 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2" returned: 0 in 1.326s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] <== create_volume: return (2810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.816s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8b18f3-ae43-4061-b18f-4635e101d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13d7b3f-1250-4c77-9939-e0bac61f5b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Volume volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 (ce146977-9b3f-4ae0-adbb-c0180cbfddc2): created successfully Jul 08 01:25:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13d7b3f-1250-4c77-9939-e0bac61f5b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Flow 'volume_create_manager' (7cb86246-e6f4-4320-9b7b-232bdf84ec16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-abebf801-91b3-4f90-8e93-eaaeff4b28a7 tempest-AbsoluteLimitsTests-814826843 None] Created volume successfully. Jul 08 01:25:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Acquiring lock "cinder-ce146977-9b3f-4ae0-adbb-c0180cbfddc2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Lock "cinder-ce146977-9b3f-4ae0-adbb-c0180cbfddc2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Acquiring lock "cinder-quobyte-ce146977-9b3f-4ae0-adbb-c0180cbfddc2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Lock "cinder-quobyte-ce146977-9b3f-4ae0-adbb-c0180cbfddc2" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cf59a6-fe32-4b44-9a79-3c0d11a2058a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:06 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 Jul 08 01:25:06 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:07 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2" returned: 0 in 0.933s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:07 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2 Jul 08 01:25:07 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:08 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ce146977-9b3f-4ae0-adbb-c0180cbfddc2" returned: 0 in 1.071s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Lock "cinder-quobyte-ce146977-9b3f-4ae0-adbb-c0180cbfddc2" released by "delete_volume" :: held 2.063s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Created reservations ['c600812d-f5dd-4fd1-ac90-b1162915ca71', '1178f898-ea0e-411d-9b75-3c1be502daf3', 'cacd5fc5-6181-4328-b877-a2b223715097', '14383172-4737-468a-86fc-701d62761cdb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:08 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:25:08 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:09 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Deleted volume successfully. Jul 08 01:25:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cda9b552-6424-4787-919f-5f8d8d5305ce tempest-AbsoluteLimitsTests-814826843 None] Lock "cinder-ce146977-9b3f-4ae0-adbb-c0180cbfddc2-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-a98a9fb6-84c9-4d38-b4ee-9fc96cf6fbf1 req-d623d170-65e7-43b0-9711-d1d0c87d64bd tempest-ServerActionsTestOtherA-2089378909 None] Terminate volume connection completed successfully. Jul 08 01:25:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-a98a9fb6-84c9-4d38-b4ee-9fc96cf6fbf1 req-d623d170-65e7-43b0-9711-d1d0c87d64bd tempest-ServerActionsTestOtherA-2089378909 None] Deleting attachment efb6a6b9-74e5-4f0d-adb8-e17feb6a9509. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Flow 'volume_create_manager' (d9d913b4-9101-4085-9ea0-86d286dbf9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e53270d-5e6f-4b14-870b-cef2e2e074c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e53270d-5e6f-4b14-870b-cef2e2e074c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-320030116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74367bbf-afc8-4599-b750-8988dd2fce0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fafc158824dc29118a5fbb0d90115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:20Z,use_quota=True,user_id='c958f876f40d419194096fc12efbc90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bcf575-a28d-4c5a-9cae-8aadea78eaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bcf575-a28d-4c5a-9cae-8aadea78eaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c8f827-9283-4bae-bebe-b7783bc5ac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c8f827-9283-4bae-bebe-b7783bc5ac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74367bbf-afc8-4599-b750-8988dd2fce0f', 'volume_name': 'volume-74367bbf-afc8-4599-b750-8988dd2fce0f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abbe2a0-9f6c-42e1-bfe9-95a09e381e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abbe2a0-9f6c-42e1-bfe9-95a09e381e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32728418-870c-49e1-aa45-c6c37405d5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Volume 74367bbf-afc8-4599-b750-8988dd2fce0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74367bbf-afc8-4599-b750-8988dd2fce0f', 'volume_size': 1} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-320030116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74367bbf-afc8-4599-b750-8988dd2fce0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fafc158824dc29118a5fbb0d90115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:20Z,use_quota=True,user_id='c958f876f40d419194096fc12efbc90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Creating volume 74367bbf-afc8-4599-b750-8988dd2fce0f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:20 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:25:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:20 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f 1073741824 Jul 08 01:25:20 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:21 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f 1073741824" returned: 0 in 1.166s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:21 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f Jul 08 01:25:21 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:22 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f" returned: 0 in 0.835s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32728418-870c-49e1-aa45-c6c37405d5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74367bbf-afc8-4599-b750-8988dd2fce0f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0dc216-8a3c-4b84-a6d8-3c11e0d244a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:22 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Volume volume-74367bbf-afc8-4599-b750-8988dd2fce0f (74367bbf-afc8-4599-b750-8988dd2fce0f): created successfully Jul 08 01:25:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0dc216-8a3c-4b84-a6d8-3c11e0d244a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Flow 'volume_create_manager' (d9d913b4-9101-4085-9ea0-86d286dbf9ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-81d62cfc-3e86-4efc-b688-84400808dbf6 tempest-VolumesTransfersV357Test-922311043 None] Created volume successfully. Jul 08 01:25:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-247872e1-f1cd-4ef9-9b87-12780868266e tempest-VolumesTransfersV357Test-56462698 None] Transfer volume completed successfully. Jul 08 01:25:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Acquiring lock "cinder-74367bbf-afc8-4599-b750-8988dd2fce0f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Lock "cinder-74367bbf-afc8-4599-b750-8988dd2fce0f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Acquiring lock "cinder-quobyte-74367bbf-afc8-4599-b750-8988dd2fce0f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Lock "cinder-quobyte-74367bbf-afc8-4599-b750-8988dd2fce0f" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae080437-6e70-4f12-93a9-d143498e86ae]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:26 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f Jul 08 01:25:26 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:27 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f" returned: 0 in 1.315s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:27 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f Jul 08 01:25:27 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:28 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-74367bbf-afc8-4599-b750-8988dd2fce0f" returned: 0 in 0.752s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Lock "cinder-quobyte-74367bbf-afc8-4599-b750-8988dd2fce0f" released by "delete_volume" :: held 2.113s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Created reservations ['330bab89-cda9-4895-856c-16a481d4d0ed', 'a3868339-16a3-4a73-a306-74fc01494c70', '3968cd4f-4949-469d-851b-378d29b1c210', '2d78f9a0-702a-4304-aed6-dd194c8654e9'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:28 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:25:28 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:29 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.824s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Deleted volume successfully. Jul 08 01:25:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6042f3be-634b-4ff2-8a15-4d7002910e9d tempest-VolumesTransfersV357Test-2095443187 None] Lock "cinder-74367bbf-afc8-4599-b750-8988dd2fce0f-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:29 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Flow 'volume_create_manager' (fc30bc74-7bfd-4344-9ecf-028a1e753081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8302f029-9d65-41e3-99e4-4db71a871996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8302f029-9d65-41e3-99e4-4db71a871996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-274260230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a98ce3-8f68-41b3-92b7-f7259ae9d69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fafc158824dc29118a5fbb0d90115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:30Z,use_quota=True,user_id='c958f876f40d419194096fc12efbc90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9930cb-250a-4b42-8f46-96ebfb757f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9930cb-250a-4b42-8f46-96ebfb757f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29d48c6-f355-4282-92e7-f63c1075aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29d48c6-f355-4282-92e7-f63c1075aa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a98ce3-8f68-41b3-92b7-f7259ae9d69e', 'volume_name': 'volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9cbd75-2723-4093-aa1f-3ec869758555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9cbd75-2723-4093-aa1f-3ec869758555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ed00a5-1bb3-4144-9a92-146571415e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Volume 36a98ce3-8f68-41b3-92b7-f7259ae9d69e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e', 'volume_size': 1} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-274260230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a98ce3-8f68-41b3-92b7-f7259ae9d69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fafc158824dc29118a5fbb0d90115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:30Z,use_quota=True,user_id='c958f876f40d419194096fc12efbc90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Creating volume 36a98ce3-8f68-41b3-92b7-f7259ae9d69e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:30 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:30 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e 1073741824 Jul 08 01:25:30 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Acquiring lock "cinder-b8b22d1a-5262-49db-af0c-9d94660f292c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Lock "cinder-b8b22d1a-5262-49db-af0c-9d94660f292c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Acquiring lock "cinder-quobyte-b8b22d1a-5262-49db-af0c-9d94660f292c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Lock "cinder-quobyte-b8b22d1a-5262-49db-af0c-9d94660f292c" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e64cdff-801e-4413-8d50-0bee5a894428]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:31 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c Jul 08 01:25:31 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:31 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e 1073741824" returned: 0 in 1.229s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:31 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e Jul 08 01:25:31 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Flow 'volume_create_manager' (9b6ecfe0-5ca9-44b9-be74-1739e448ba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd87b2c5-a5e0-4419-9c83-a6471672a99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd87b2c5-a5e0-4419-9c83-a6471672a99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-892976887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07797788-80df-4c82-9626-9b2a77f73960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8049ad2560114639a8b0cbfd4577568f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:31Z,use_quota=True,user_id='61122e7f7cd34bb0a0963464d0e3ba1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db8d8be-e70c-4336-9f96-cca9e1f4abc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db8d8be-e70c-4336-9f96-cca9e1f4abc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102c9532-02e2-40bb-adc8-9c2dfb50b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102c9532-02e2-40bb-adc8-9c2dfb50b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07797788-80df-4c82-9626-9b2a77f73960', 'volume_name': 'volume-07797788-80df-4c82-9626-9b2a77f73960', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403e15a9-53ae-4c9f-b4f0-3f1111b5ea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403e15a9-53ae-4c9f-b4f0-3f1111b5ea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1e903c-f7df-4af5-bd62-6998d9aa51b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Volume 07797788-80df-4c82-9626-9b2a77f73960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07797788-80df-4c82-9626-9b2a77f73960', 'volume_size': 1} Jul 08 01:25:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:32 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c" returned: 0 in 1.423s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:32 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c Jul 08 01:25:32 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:32 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e" returned: 0 in 1.169s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] <== create_volume: return (2481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.891s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-892976887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07797788-80df-4c82-9626-9b2a77f73960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8049ad2560114639a8b0cbfd4577568f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:31Z,use_quota=True,user_id='61122e7f7cd34bb0a0963464d0e3ba1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Creating volume 07797788-80df-4c82-9626-9b2a77f73960 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:32 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:32 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 1073741824 Jul 08 01:25:32 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ed00a5-1bb3-4144-9a92-146571415e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54787761-3645-4284-8cb3-b844511c4180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Volume volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e (36a98ce3-8f68-41b3-92b7-f7259ae9d69e): created successfully Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54787761-3645-4284-8cb3-b844511c4180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Flow 'volume_create_manager' (fc30bc74-7bfd-4344-9ecf-028a1e753081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6fbcab91-dbfd-488d-8c1a-fd21cb3166b7 tempest-VolumesTransfersV357Test-922311043 None] Created volume successfully. Jul 08 01:25:33 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8b22d1a-5262-49db-af0c-9d94660f292c" returned: 0 in 0.795s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Lock "cinder-quobyte-b8b22d1a-5262-49db-af0c-9d94660f292c" released by "delete_volume" :: held 2.291s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Created reservations ['4e657aef-d1b3-422a-a813-e19e7f405ae8', '0f72b97f-f2af-47b9-8cf4-4324d286fe0b', '60478f69-93c0-4b3b-a904-38dc6b3a2aaf', '6efbf04e-88fb-4efa-9338-d44a750fbfd5'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:33 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:25:33 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Acquiring lock "cinder-36a98ce3-8f68-41b3-92b7-f7259ae9d69e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Lock "cinder-36a98ce3-8f68-41b3-92b7-f7259ae9d69e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Acquiring lock "cinder-quobyte-36a98ce3-8f68-41b3-92b7-f7259ae9d69e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Lock "cinder-quobyte-36a98ce3-8f68-41b3-92b7-f7259ae9d69e" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bbfe64-e09a-42e7-ad79-e63a3b5db29b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:33 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 1073741824" returned: 0 in 1.381s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:34 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e Jul 08 01:25:34 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:34 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 Jul 08 01:25:34 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:34 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.984s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:34 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Deleted volume successfully. Jul 08 01:25:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1fb210c-5c0d-4f03-bcc7-0f9f7b384fbd tempest-ServerActionsTestOtherA-2089378909 None] Lock "cinder-b8b22d1a-5262-49db-af0c-9d94660f292c-delete_volume" released by "delete_volume" :: held 3.680s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:34 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960" returned: 0 in 0.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1e903c-f7df-4af5-bd62-6998d9aa51b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07797788-80df-4c82-9626-9b2a77f73960', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97088efc-6c0c-4b23-b6c3-e823afd40b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:35 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Volume volume-07797788-80df-4c82-9626-9b2a77f73960 (07797788-80df-4c82-9626-9b2a77f73960): created successfully Jul 08 01:25:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97088efc-6c0c-4b23-b6c3-e823afd40b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Flow 'volume_create_manager' (9b6ecfe0-5ca9-44b9-be74-1739e448ba46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fd6bc69f-ee4d-4067-becd-4bff828a9542 tempest-AttachVolumeTestJSON-19192547 None] Created volume successfully. Jul 08 01:25:35 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e" returned: 0 in 1.419s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:35 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e Jul 08 01:25:35 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:36 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36a98ce3-8f68-41b3-92b7-f7259ae9d69e" returned: 0 in 0.962s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Lock "cinder-quobyte-36a98ce3-8f68-41b3-92b7-f7259ae9d69e" released by "delete_volume" :: held 2.440s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Created reservations ['37a21bcf-97d2-45b7-b901-3857bab0a391', '4d8863a4-251d-439c-82f2-08df3afd7fb4', '87619ea5-2d40-46c9-a310-3a385ecb31bc', '72207216-9edf-4b7b-b17a-1aba5d40f4f4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:36 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:25:36 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:37 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.421s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:37 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Deleted volume successfully. Jul 08 01:25:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-490d44c4-1b80-47b7-9a1e-30278d9f75e3 tempest-VolumesTransfersV357Test-2095443187 None] Lock "cinder-36a98ce3-8f68-41b3-92b7-f7259ae9d69e-delete_volume" released by "delete_volume" :: held 4.206s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d7c1c62c-d54d-43e0-8fdd-8918e80b89b3 req-c3c4cefb-92b4-4bfc-9af8-64e4f51754be tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d7c1c62c-d54d-43e0-8fdd-8918e80b89b3 req-c3c4cefb-92b4-4bfc-9af8-64e4f51754be tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7af7f0-da3f-4230-a065-e0e1ca350c78]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d7c1c62c-d54d-43e0-8fdd-8918e80b89b3 req-c3c4cefb-92b4-4bfc-9af8-64e4f51754be tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:39 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 Jul 08 01:25:39 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:40 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d7c1c62c-d54d-43e0-8fdd-8918e80b89b3 req-c3c4cefb-92b4-4bfc-9af8-64e4f51754be tempest-AttachVolumeTestJSON-19192547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960" returned: 0 in 1.219s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d7c1c62c-d54d-43e0-8fdd-8918e80b89b3 req-c3c4cefb-92b4-4bfc-9af8-64e4f51754be tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.281s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-d7c1c62c-d54d-43e0-8fdd-8918e80b89b3 req-c3c4cefb-92b4-4bfc-9af8-64e4f51754be tempest-AttachVolumeTestJSON-19192547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-07797788-80df-4c82-9626-9b2a77f73960', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e16d81fc-9e68-45b5-ad08-9dd369a59d94', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:25:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-d7c1c62c-d54d-43e0-8fdd-8918e80b89b3 req-c3c4cefb-92b4-4bfc-9af8-64e4f51754be tempest-AttachVolumeTestJSON-19192547 None] attachment_update completed successfully. Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Flow 'volume_create_manager' (abb8101d-2b01-4cb3-9ad3-175ebce2b3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e4f413-8e43-4422-a184-9a42de34c76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e4f413-8e43-4422-a184-9a42de34c76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1066652370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8049ad2560114639a8b0cbfd4577568f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:47Z,use_quota=True,user_id='61122e7f7cd34bb0a0963464d0e3ba1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a44112e-67c4-489a-be21-f66d5afa601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a44112e-67c4-489a-be21-f66d5afa601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf28bc7-75f2-457b-81af-4f6e305f6e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf28bc7-75f2-457b-81af-4f6e305f6e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c', 'volume_name': 'volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e82dbc-31ab-4d63-8f97-2471b41cebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e82dbc-31ab-4d63-8f97-2471b41cebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90b0813-d6ea-414c-9dd6-99aa7c46ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Volume 3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c', 'volume_size': 1} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1066652370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8049ad2560114639a8b0cbfd4577568f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:47Z,use_quota=True,user_id='61122e7f7cd34bb0a0963464d0e3ba1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Creating volume 3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:46 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:25:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:46 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c 1073741824 Jul 08 01:25:46 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Flow 'volume_create_manager' (83aca6b3-9751-4839-8cfd-fc6568d9701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c18eced-2e22-4bac-ae29-8ae02fad6ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c18eced-2e22-4bac-ae29-8ae02fad6ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1913130478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b2d58e-6219-4d41-9c5e-317c8a161074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f6a934cc784e60b28e33edc4b4bacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:47Z,use_quota=True,user_id='4ffa7f64588c4063ba36305e59a5a4fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4fa22e-8292-4dad-9b92-6b75200ccf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4fa22e-8292-4dad-9b92-6b75200ccf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cf1ccd-348b-4885-8729-c3b817393ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cf1ccd-348b-4885-8729-c3b817393ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b2d58e-6219-4d41-9c5e-317c8a161074', 'volume_name': 'volume-44b2d58e-6219-4d41-9c5e-317c8a161074', 'volume_size': 2}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e76016c-7f48-4d10-b483-d9dc7b0986be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e76016c-7f48-4d10-b483-d9dc7b0986be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75b576b-4a13-4592-b29b-dfc2ad336452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:47 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Volume 44b2d58e-6219-4d41-9c5e-317c8a161074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b2d58e-6219-4d41-9c5e-317c8a161074', 'volume_size': 2} Jul 08 01:25:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:48 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c 1073741824" returned: 0 in 1.224s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:48 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c Jul 08 01:25:48 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:48 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c" returned: 0 in 0.846s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.729s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1913130478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b2d58e-6219-4d41-9c5e-317c8a161074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f6a934cc784e60b28e33edc4b4bacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:47Z,use_quota=True,user_id='4ffa7f64588c4063ba36305e59a5a4fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Creating volume 44b2d58e-6219-4d41-9c5e-317c8a161074 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:48 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074 2147483648 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:48 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074 2147483648 Jul 08 01:25:48 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90b0813-d6ea-414c-9dd6-99aa7c46ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e3d4dc-c20d-4c56-b640-99ab907d662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Volume volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c (3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c): created successfully Jul 08 01:25:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e3d4dc-c20d-4c56-b640-99ab907d662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Flow 'volume_create_manager' (abb8101d-2b01-4cb3-9ad3-175ebce2b3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a3b3b80-4a4d-4a0a-aa78-2b1cdb7b5355 tempest-AttachVolumeTestJSON-19192547 None] Created volume successfully. Jul 08 01:25:50 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074 2147483648" returned: 0 in 1.102s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:50 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074 Jul 08 01:25:50 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:50 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074" returned: 0 in 0.738s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75b576b-4a13-4592-b29b-dfc2ad336452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b2d58e-6219-4d41-9c5e-317c8a161074', 'volume_size': 2}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc348f2-1d43-499f-b805-6ca6526240d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Volume volume-44b2d58e-6219-4d41-9c5e-317c8a161074 (44b2d58e-6219-4d41-9c5e-317c8a161074): created successfully Jul 08 01:25:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc348f2-1d43-499f-b805-6ca6526240d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Flow 'volume_create_manager' (83aca6b3-9751-4839-8cfd-fc6568d9701f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4923aaaf-800e-4c76-ada0-f7e72481631c tempest-VolumesCloneNegativeTest-1486166881 None] Created volume successfully. Jul 08 01:25:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Acquiring lock "cinder-44b2d58e-6219-4d41-9c5e-317c8a161074-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Lock "cinder-44b2d58e-6219-4d41-9c5e-317c8a161074-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Acquiring lock "cinder-quobyte-44b2d58e-6219-4d41-9c5e-317c8a161074" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Lock "cinder-quobyte-44b2d58e-6219-4d41-9c5e-317c8a161074" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bafbed3-4d6d-4394-8cf2-eed5669060a9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:51 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074 Jul 08 01:25:51 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:52 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074" returned: 0 in 0.938s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:52 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074 Jul 08 01:25:52 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-6d00b608-d3c5-4213-9955-d7b18eb8d000 req-6c0e5352-f445-4619-983e-80043aa42c12 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-6d00b608-d3c5-4213-9955-d7b18eb8d000 req-6c0e5352-f445-4619-983e-80043aa42c12 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d9d78-f4b9-4288-8ffa-a568d060af58]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-6d00b608-d3c5-4213-9955-d7b18eb8d000 req-6c0e5352-f445-4619-983e-80043aa42c12 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:53 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c Jul 08 01:25:53 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:53 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44b2d58e-6219-4d41-9c5e-317c8a161074" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Lock "cinder-quobyte-44b2d58e-6219-4d41-9c5e-317c8a161074" released by "delete_volume" :: held 1.737s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Created reservations ['50dad4ed-ba89-47de-9c18-d33a505af5e9', 'a723d19d-466b-4f7b-9630-783b33b731c5', '0a5a72b9-2f45-4308-8883-29f3c5526c0f', '0d08e772-9d3b-4712-81d6-aca657689970'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:53 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:25:53 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:53 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:25:53 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:54 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-6d00b608-d3c5-4213-9955-d7b18eb8d000 req-6c0e5352-f445-4619-983e-80043aa42c12 tempest-AttachVolumeTestJSON-19192547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c" returned: 0 in 1.261s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-6d00b608-d3c5-4213-9955-d7b18eb8d000 req-6c0e5352-f445-4619-983e-80043aa42c12 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.281s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=40,cinder:UPDATE=64,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=55,cinder:UPDATE=56,cinder:DELETE=6,cinder:INSERT=10 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-6d00b608-d3c5-4213-9955-d7b18eb8d000 req-6c0e5352-f445-4619-983e-80043aa42c12 tempest-AttachVolumeTestJSON-19192547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d798eb4-bd80-40f9-bc5f-6e494fea6a6b', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:25:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-6d00b608-d3c5-4213-9955-d7b18eb8d000 req-6c0e5352-f445-4619-983e-80043aa42c12 tempest-AttachVolumeTestJSON-19192547 None] attachment_update completed successfully. Jul 08 01:25:54 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.070s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Deleted volume successfully. Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d7111bf-4846-412a-aa7c-e7f9c6e815e3 tempest-VolumesCloneNegativeTest-1486166881 None] Lock "cinder-44b2d58e-6219-4d41-9c5e-317c8a161074-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:54 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.056s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:25:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (242207d6-b54e-4435-8fb2-1c8a8e7a8a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4925cb83-206f-41b1-92e7-5cf44ad1b1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4925cb83-206f-41b1-92e7-5cf44ad1b1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-285146631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d710e2-0ad4-4b4a-9603-c28c54c252a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:58Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1758a67b-054f-4d73-af24-59ebe092f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1758a67b-054f-4d73-af24-59ebe092f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460d9e23-7d27-46a1-b005-da2514732629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460d9e23-7d27-46a1-b005-da2514732629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d710e2-0ad4-4b4a-9603-c28c54c252a9', 'volume_name': 'volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c642aefe-780e-4baf-8154-16c5184ff7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c642aefe-780e-4baf-8154-16c5184ff7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56127b1-357f-4899-8075-5175d45a7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Volume 45d710e2-0ad4-4b4a-9603-c28c54c252a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9', 'volume_size': 1} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-285146631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d710e2-0ad4-4b4a-9603-c28c54c252a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:58Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Creating volume 45d710e2-0ad4-4b4a-9603-c28c54c252a9 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:58 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:25:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:58 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 1073741824 Jul 08 01:25:58 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:59 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 1073741824" returned: 0 in 1.181s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:59 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 Jul 08 01:25:59 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-bc4b41a9-ed28-4c4e-a955-a9ce110257fb req-42deafe4-3b8d-4a8f-9420-94bbd9bcb5ea tempest-AttachVolumeTestJSON-19192547 None] Terminate volume connection completed successfully. Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-bc4b41a9-ed28-4c4e-a955-a9ce110257fb req-42deafe4-3b8d-4a8f-9420-94bbd9bcb5ea tempest-AttachVolumeTestJSON-19192547 None] Deleting attachment e16d81fc-9e68-45b5-ad08-9dd369a59d94. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:00 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Flow 'volume_create_manager' (60c50aa6-627a-4ec1-9d92-ef485b0eb130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fbdbd9-ce18-4a90-a8f0-0a7c7494f07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9" returned: 0 in 1.289s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] <== create_volume: return (2546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.549s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fbdbd9-ce18-4a90-a8f0-0a7c7494f07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-316729396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f4f437-a9a7-450a-be40-276e3e00af50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e9e6ae08ce4a718e5ae765e6c2ac2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:01Z,use_quota=True,user_id='c7632b2b165f48d397d6eeab78f0687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7e1524-36e4-455c-9119-e8beea05ae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7e1524-36e4-455c-9119-e8beea05ae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b80429a-a655-43f8-b0d4-7f01da4cf045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b80429a-a655-43f8-b0d4-7f01da4cf045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f4f437-a9a7-450a-be40-276e3e00af50', 'volume_name': 'volume-c1f4f437-a9a7-450a-be40-276e3e00af50', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e05f3-8220-472f-9c75-78445c775edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e05f3-8220-472f-9c75-78445c775edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20feb03-730f-44e7-9300-1db8ba33cc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Volume c1f4f437-a9a7-450a-be40-276e3e00af50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f4f437-a9a7-450a-be40-276e3e00af50', 'volume_size': 1} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-316729396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f4f437-a9a7-450a-be40-276e3e00af50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e9e6ae08ce4a718e5ae765e6c2ac2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:01Z,use_quota=True,user_id='c7632b2b165f48d397d6eeab78f0687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Creating volume c1f4f437-a9a7-450a-be40-276e3e00af50 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:00 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56127b1-357f-4899-8075-5175d45a7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403f6322-e00f-4fa5-9dee-7594ecb59b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:00 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 1073741824 Jul 08 01:26:00 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Volume volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 (45d710e2-0ad4-4b4a-9603-c28c54c252a9): created successfully Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403f6322-e00f-4fa5-9dee-7594ecb59b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (242207d6-b54e-4435-8fb2-1c8a8e7a8a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2d04aaeb-8cde-4dd9-b01b-a9e6f89eaf46 tempest-VolumesGetTest-905710318 None] Created volume successfully. Jul 08 01:26:02 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 1073741824" returned: 0 in 1.865s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:02 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 Jul 08 01:26:02 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (f6fddc62-a089-46ef-b5ce-b694f6a92f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa18861-88e4-4fdb-bc82-56df18afded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa18861-88e4-4fdb-bc82-56df18afded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860509791',display_name='tempest-VolumesGetTest-Volume-1989066478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728cb6a7-5205-424a-b629-78c24c15d132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:03Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7d2e2f-dd4a-4ff2-95de-780554f1a23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7d2e2f-dd4a-4ff2-95de-780554f1a23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ccb234-def9-41d3-827b-b63b5620d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ccb234-def9-41d3-827b-b63b5620d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728cb6a7-5205-424a-b629-78c24c15d132', 'volume_name': 'volume-728cb6a7-5205-424a-b629-78c24c15d132', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c0452e-9ac7-4cf9-b159-4cb82206b8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c0452e-9ac7-4cf9-b159-4cb82206b8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70221d3-8b05-478a-892d-4cbd81262320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Volume 728cb6a7-5205-424a-b629-78c24c15d132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728cb6a7-5205-424a-b629-78c24c15d132', 'volume_size': 1} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:03 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50" returned: 0 in 0.983s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] <== create_volume: return (2917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.919s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860509791',display_name='tempest-VolumesGetTest-Volume-1989066478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728cb6a7-5205-424a-b629-78c24c15d132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:03Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Creating volume 728cb6a7-5205-424a-b629-78c24c15d132 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:03 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:03 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132 1073741824 Jul 08 01:26:03 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20feb03-730f-44e7-9300-1db8ba33cc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f4f437-a9a7-450a-be40-276e3e00af50', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac80450e-11ae-4eda-b18c-a9784571d1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-de67707d-55db-4dcc-8cc4-cf8be7296c02 req-3e4cb77d-5e14-480f-80f9-5de02fb4e0d6 tempest-AttachVolumeTestJSON-19192547 None] Terminate volume connection completed successfully. Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-de67707d-55db-4dcc-8cc4-cf8be7296c02 req-3e4cb77d-5e14-480f-80f9-5de02fb4e0d6 tempest-AttachVolumeTestJSON-19192547 None] Deleting attachment 7d798eb4-bd80-40f9-bc5f-6e494fea6a6b. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:26:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Volume volume-c1f4f437-a9a7-450a-be40-276e3e00af50 (c1f4f437-a9a7-450a-be40-276e3e00af50): created successfully Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac80450e-11ae-4eda-b18c-a9784571d1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Flow 'volume_create_manager' (60c50aa6-627a-4ec1-9d92-ef485b0eb130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d3e0ed7c-4f6c-4e5e-b1d7-bf7639ecdf18 tempest-AttachVolumeNegativeTest-1709776555 None] Created volume successfully. Jul 08 01:26:05 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132 1073741824" returned: 0 in 1.221s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:05 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132 Jul 08 01:26:05 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:05 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132" returned: 0 in 0.880s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70221d3-8b05-478a-892d-4cbd81262320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728cb6a7-5205-424a-b629-78c24c15d132', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c5baf7-7086-4919-b478-de74f6de8d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:06 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Volume volume-728cb6a7-5205-424a-b629-78c24c15d132 (728cb6a7-5205-424a-b629-78c24c15d132): created successfully Jul 08 01:26:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c5baf7-7086-4919-b478-de74f6de8d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (f6fddc62-a089-46ef-b5ce-b694f6a92f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4907350a-0e1f-4eb6-80b0-f9f402375d99 tempest-VolumesGetTest-905710318 None] Created volume successfully. Jul 08 01:26:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-728cb6a7-5205-424a-b629-78c24c15d132-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Lock "cinder-728cb6a7-5205-424a-b629-78c24c15d132-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-quobyte-728cb6a7-5205-424a-b629-78c24c15d132" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-728cb6a7-5205-424a-b629-78c24c15d132" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6543ba-2e50-471d-88ce-1c665ef2a20b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:07 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132 Jul 08 01:26:07 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d087692c-a0ac-4b15-b2b0-b1c16983bb80 req-08b89f16-7e57-456a-8a97-5494b6485953 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d087692c-a0ac-4b15-b2b0-b1c16983bb80 req-08b89f16-7e57-456a-8a97-5494b6485953 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e8cea0-1fd9-4444-8fce-0e731d777526]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d087692c-a0ac-4b15-b2b0-b1c16983bb80 req-08b89f16-7e57-456a-8a97-5494b6485953 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:08 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 Jul 08 01:26:08 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:08 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132" returned: 0 in 1.244s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:08 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132 Jul 08 01:26:08 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:09 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d087692c-a0ac-4b15-b2b0-b1c16983bb80 req-08b89f16-7e57-456a-8a97-5494b6485953 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50" returned: 0 in 1.026s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d087692c-a0ac-4b15-b2b0-b1c16983bb80 req-08b89f16-7e57-456a-8a97-5494b6485953 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.054s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:09 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-728cb6a7-5205-424a-b629-78c24c15d132" returned: 0 in 0.924s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-728cb6a7-5205-424a-b629-78c24c15d132" released by "delete_volume" :: held 2.250s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-d087692c-a0ac-4b15-b2b0-b1c16983bb80 req-08b89f16-7e57-456a-8a97-5494b6485953 tempest-AttachVolumeNegativeTest-1709776555 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-c1f4f437-a9a7-450a-be40-276e3e00af50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88bf5a45-1113-4fd7-be3b-7b54891e6451', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:26:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Created reservations ['42fba1dd-6fc8-4910-a815-b4efb7c11277', 'af755c34-00f1-46a9-bc4c-a388f222e26f', '922bcc24-6900-4e08-a181-6b6706fb4990', '21dd2a56-d67e-4c39-8841-3f8b080ee6cd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-d087692c-a0ac-4b15-b2b0-b1c16983bb80 req-08b89f16-7e57-456a-8a97-5494b6485953 tempest-AttachVolumeNegativeTest-1709776555 None] attachment_update completed successfully. Jul 08 01:26:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:10 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:26:10 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-45d710e2-0ad4-4b4a-9603-c28c54c252a9-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Lock "cinder-45d710e2-0ad4-4b4a-9603-c28c54c252a9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-quobyte-45d710e2-0ad4-4b4a-9603-c28c54c252a9" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-45d710e2-0ad4-4b4a-9603-c28c54c252a9" acquired by "delete_volume" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c4cc5d-32b8-4b94-908b-fde528324cb6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:11 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 Jul 08 01:26:11 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:11 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.506s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:11 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Deleted volume successfully. Jul 08 01:26:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-955a2016-ad59-4bbe-b3a5-5e8b2f2779da tempest-VolumesGetTest-905710318 None] Lock "cinder-728cb6a7-5205-424a-b629-78c24c15d132-delete_volume" released by "delete_volume" :: held 4.381s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:12 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9" returned: 0 in 1.286s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:12 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9 Jul 08 01:26:12 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:13 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-45d710e2-0ad4-4b4a-9603-c28c54c252a9" returned: 0 in 1.061s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-45d710e2-0ad4-4b4a-9603-c28c54c252a9" released by "delete_volume" :: held 2.424s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Created reservations ['93e85303-31c4-46f1-832f-334914a917ae', '7e61c614-6572-498c-8310-deca29077e37', '08387e04-98f3-4728-83d6-096cedab51c3', '38ea2223-bfbe-484e-869b-4e3257cc8412'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:13 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:26:13 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:14 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.037s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:14 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Deleted volume successfully. Jul 08 01:26:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a29dbc55-4ea9-44c8-b830-28858e0f4b97 tempest-VolumesGetTest-905710318 None] Lock "cinder-45d710e2-0ad4-4b4a-9603-c28c54c252a9-delete_volume" released by "delete_volume" :: held 3.784s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (05368d88-08fd-4664-852a-5e9cdc83880d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a45d2a8-51e0-4c50-956a-82f5bd2910e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a45d2a8-51e0-4c50-956a-82f5bd2910e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-340885518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:16Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e6b57c-7dc2-4412-84fd-0ce959f0e959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e6b57c-7dc2-4412-84fd-0ce959f0e959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf85e0b-68be-4ffe-a739-4003c3e22399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf85e0b-68be-4ffe-a739-4003c3e22399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72', 'volume_name': 'volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f2c3ef-2d6e-4731-b165-0bc38b42b79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f2c3ef-2d6e-4731-b165-0bc38b42b79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1c7162-4088-4b6e-af22-b88fa8e958a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:15 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Volume 2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72', 'volume_size': 1} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-340885518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:16Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Creating volume 2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:15 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:26:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:15 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 1073741824 Jul 08 01:26:15 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:17 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 1073741824" returned: 0 in 1.381s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:17 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 Jul 08 01:26:17 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-24aa3d08-b884-4f8e-8bd8-1edb96e52892 req-1cdbef94-9fc0-4643-80d7-f5b4b12d6fbb tempest-AttachVolumeNegativeTest-1709776555 None] Terminate volume connection completed successfully. Jul 08 01:26:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-24aa3d08-b884-4f8e-8bd8-1edb96e52892 req-1cdbef94-9fc0-4643-80d7-f5b4b12d6fbb tempest-AttachVolumeNegativeTest-1709776555 None] Deleting attachment 88bf5a45-1113-4fd7-be3b-7b54891e6451. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:26:18 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" returned: 0 in 1.039s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.523s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1c7162-4088-4b6e-af22-b88fa8e958a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ebc771-c636-452d-97a1-3ecfdda7f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Volume volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 (2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72): created successfully Jul 08 01:26:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ebc771-c636-452d-97a1-3ecfdda7f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (05368d88-08fd-4664-852a-5e9cdc83880d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7c1fbc1c-3ac1-4c25-9f97-2ef679274a6e tempest-VolumesGetTest-905710318 None] Created volume successfully. Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "cinder-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "cinder-quobyte-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-quobyte-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b70d4e-2c6e-4ed5-817c-20a5464694de]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:19 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c Jul 08 01:26:19 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (ebf088fd-cb17-409f-9c8f-c8bef783941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3278ae16-c306-40a3-a370-febb4a5b6cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3278ae16-c306-40a3-a370-febb4a5b6cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-461190959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54883fa5-1fd1-4869-ba51-9a8ce073a747,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:20Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e079ef18-26cd-4542-83ec-6b46f0b8a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e079ef18-26cd-4542-83ec-6b46f0b8a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc66137-d6db-4c95-83e3-f4b34c3e3a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc66137-d6db-4c95-83e3-f4b34c3e3a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '54883fa5-1fd1-4869-ba51-9a8ce073a747', 'volume_name': 'volume-54883fa5-1fd1-4869-ba51-9a8ce073a747', 'volume_size': 1, 'source_volid': '2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72', 'source_volstatus': 'available'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dd52d6-ba07-43aa-974d-e08035560953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dd52d6-ba07-43aa-974d-e08035560953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bc0fbd-0d03-4ad9-954c-ef6793c9096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Volume 54883fa5-1fd1-4869-ba51-9a8ce073a747: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-54883fa5-1fd1-4869-ba51-9a8ce073a747', 'volume_size': 1, 'source_volid': '2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72', 'source_volstatus': 'available'} Jul 08 01:26:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:20 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Cloning volume 2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 to volume 54883fa5-1fd1-4869-ba51-9a8ce073a747 Jul 08 01:26:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Creating offline snapshot b2664c2f-8823-4594-b813-24de1536e22f of volume 2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:26:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0217c8-844f-4d87-8e70-09e14377bbc8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:20 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 Jul 08 01:26:20 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:20 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c" returned: 0 in 1.601s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:20 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c Jul 08 01:26:20 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:21 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c" returned: 0 in 1.069s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:21 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-quobyte-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c" released by "delete_volume" :: held 2.728s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" returned: 0 in 1.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:22 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f 1G Jul 08 01:26:22 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:22 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Created reservations ['a57d1620-a6a3-415f-9351-9c7dd06a31cd', 'ebb9db0c-eb98-4689-b415-509f94cd82bc', '0b36d464-3a71-452e-8482-17882afece12', '0c1bf3a0-cc35-4786-96a6-eb31e16a6eaf'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:22 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:26:22 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "cinder-07797788-80df-4c82-9626-9b2a77f73960-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-07797788-80df-4c82-9626-9b2a77f73960-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "cinder-quobyte-07797788-80df-4c82-9626-9b2a77f73960" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-quobyte-07797788-80df-4c82-9626-9b2a77f73960" acquired by "delete_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ce283-7059-4d02-815f-e19c8e5fd1d7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:23 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.647s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:23 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Deleted volume successfully. Jul 08 01:26:23 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 Jul 08 01:26:23 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3acfb58-cd4c-4d9c-a7db-6ee2df68d620 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-3bc5e5bb-70c4-4bf6-8af3-cacddb78bc5c-delete_volume" released by "delete_volume" :: held 4.822s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:24 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f 1G" returned: 0 in 2.173s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:24 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f Jul 08 01:26:24 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:25 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960" returned: 0 in 2.310s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:25 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f" returned: 0 in 1.613s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:25 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f is being set with open permissions: ugo+rw Jul 08 01:26:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:25 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960 Jul 08 01:26:25 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:25 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f Jul 08 01:26:25 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:27 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-07797788-80df-4c82-9626-9b2a77f73960" returned: 0 in 1.496s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-quobyte-07797788-80df-4c82-9626-9b2a77f73960" released by "delete_volume" :: held 3.936s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Created reservations ['e68ad01f-ce37-467c-9ed4-789a91139f7d', '6e6c9ce4-1535-4802-b618-7460e51567db', 'ffb35987-611b-47cf-b692-f9d0fc4c4ddd', '5fb92299-413a-485c-8ea0-fa69c02f60fd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:27 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f" returned: 0 in 1.634s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:27 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.info Jul 08 01:26:27 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:27 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:26:27 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "cinder-c5a7d5ec-5057-4352-952d-c707fb293503-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-c5a7d5ec-5057-4352-952d-c707fb293503-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "cinder-quobyte-c5a7d5ec-5057-4352-952d-c707fb293503" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-quobyte-c5a7d5ec-5057-4352-952d-c707fb293503" acquired by "delete_volume" :: waited 0.077s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:28 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.info" returned: 0 in 1.058s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:28 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.info is being set with open permissions: ugo+rw Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17ce32-4fcb-47f3-ac32-c3b73501d01b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:28 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:28 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.info Jul 08 01:26:28 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.086s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Deleted volume successfully. Jul 08 01:26:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4ad58349-3f1f-4ba9-8787-6a9c5e507173 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-07797788-80df-4c82-9626-9b2a77f73960-delete_volume" released by "delete_volume" :: held 5.675s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:28 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 Jul 08 01:26:28 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:30 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503" returned: 0 in 1.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:30 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503 Jul 08 01:26:30 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:30 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.info" returned: 0 in 1.837s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-quobyte-54883fa5-1fd1-4869-ba51-9a8ce073a747" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-54883fa5-1fd1-4869-ba51-9a8ce073a747" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] snapshot: b2664c2f-8823-4594-b813-24de1536e22f, volume: 54883fa5-1fd1-4869-ba51-9a8ce073a747, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc368cf-a882-4ce8-a072-2c5ec9e86cc8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:30 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f Jul 08 01:26:30 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:31 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c5a7d5ec-5057-4352-952d-c707fb293503" returned: 0 in 1.414s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-quobyte-c5a7d5ec-5057-4352-952d-c707fb293503" released by "delete_volume" :: held 3.339s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:31 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Created reservations ['cc3bc066-1665-42a8-9e8e-3e61e7ffaa5c', '9e0704e7-37ec-42e2-a1e4-b0ec7502026b', 'e9525b49-3509-4a90-9517-639d067290ae', '25bfd694-f78f-4090-8e94-d81878771e18'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:32 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:26:32 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:32 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f" returned: 0 in 2.322s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f57b7c-5468-4ed2-a788-9a465afd80c9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:33 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 Jul 08 01:26:33 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:34 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 2.237s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:34 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Deleted volume successfully. Jul 08 01:26:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15630375-7da2-4ba9-9060-740458bd0565 tempest-AttachVolumeTestJSON-19192547 None] Lock "cinder-c5a7d5ec-5057-4352-952d-c707fb293503-delete_volume" released by "delete_volume" :: held 6.275s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:34 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" returned: 0 in 1.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:34 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:26:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:34 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 Jul 08 01:26:34 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:42 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=53,cinder:UPDATE=56,cinder:DELETE=6,cinder:INSERT=13 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:26:44 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=45,cinder:UPDATE=56,cinder:DELETE=4,cinder:INSERT=13 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:26:44 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747" returned: 0 in 9.689s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8deb79-8c74-4d8f-8c2f-8e38ad5bc919]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:44 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 Jul 08 01:26:44 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:46 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" returned: 0 in 1.533s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:46 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72, size 1024.00 MB, duration 9.69 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:26:46 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Converted 1024.00 MB image at 105.68 MB/s Jul 08 01:26:46 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 is being set with open permissions: ugo+rw Jul 08 01:26:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:46 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 Jul 08 01:26:46 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:47 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747" returned: 0 in 1.303s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-54883fa5-1fd1-4869-ba51-9a8ce073a747" released by "_copy_volume_from_snapshot" :: held 16.910s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-quobyte-b2664c2f-8823-4594-b813-24de1536e22f" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-b2664c2f-8823-4594-b813-24de1536e22f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Deleting offline snapshot b2664c2f-8823-4594-b813-24de1536e22f of volume 2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:26:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] snapshot_file for this snap is: volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:26:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef776e3-ee26-4af7-b0ca-78deb301c551]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:47 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f Jul 08 01:26:47 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:48 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f" returned: 0 in 1.285s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:26:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d9ad7c-28b2-469c-8582-71ba8d9ae4f1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:48 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 Jul 08 01:26:48 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:50 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Flow 'volume_create_manager' (6fd0e7f5-dcbb-4f6b-9572-6609a63bcfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66a8d98-491e-42be-9835-57ac75f7f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" returned: 0 in 1.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:50 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f Jul 08 01:26:50 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66a8d98-491e-42be-9835-57ac75f7f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1512254515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0629fb52-de83-40b9-bdae-c2c9d4eca5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446fd24d55d74efea7943920be151589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:51Z,use_quota=True,user_id='e09cb85b1afa4f12a3c1e857fd6c4987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb909ab-75e0-49bd-ab26-fad394b82e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb909ab-75e0-49bd-ab26-fad394b82e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5684fc91-bc25-48b4-8bb2-569ab359468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5684fc91-bc25-48b4-8bb2-569ab359468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0629fb52-de83-40b9-bdae-c2c9d4eca5c4', 'volume_name': 'volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdafe164-46f5-45a6-8e3b-867e154d5d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdafe164-46f5-45a6-8e3b-867e154d5d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae58a041-f2a8-4e15-b7d2-e87d3975f8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Volume 0629fb52-de83-40b9-bdae-c2c9d4eca5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4', 'volume_size': 1} Jul 08 01:26:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:51 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f" returned: 0 in 0.924s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:51 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f Jul 08 01:26:51 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Flow 'volume_create_manager' (87cc112f-03c1-4fe7-b86e-65d4cd218554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a38d671-0184-4c2a-ada4-393c3361262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a38d671-0184-4c2a-ada4-393c3361262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-666386095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3678c56b-b52e-4698-b3d6-e4a4e355162e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6cd89c1bb841989065421978485ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:52Z,use_quota=True,user_id='10d8a3f6cd604958a6962bcf2d163cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7149c802-442b-4155-b480-e287d7933583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7149c802-442b-4155-b480-e287d7933583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea3cf96-4e29-43ff-b541-bcb36b4fa257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea3cf96-4e29-43ff-b541-bcb36b4fa257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3678c56b-b52e-4698-b3d6-e4a4e355162e', 'volume_name': 'volume-3678c56b-b52e-4698-b3d6-e4a4e355162e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc5b6f4-a7b5-45fc-a1dd-6409f1a7127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc5b6f4-a7b5-45fc-a1dd-6409f1a7127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5a5b8f-edb7-4bbb-9b0b-1bb60ee173c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Volume 3678c56b-b52e-4698-b3d6-e4a4e355162e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3678c56b-b52e-4698-b3d6-e4a4e355162e', 'volume_size': 1} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:52 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72.b2664c2f-8823-4594-b813-24de1536e22f" returned: 0 in 0.939s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-b2664c2f-8823-4594-b813-24de1536e22f" released by "_delete_snapshot" :: held 5.197s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 32.630s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1512254515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0629fb52-de83-40b9-bdae-c2c9d4eca5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446fd24d55d74efea7943920be151589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:51Z,use_quota=True,user_id='e09cb85b1afa4f12a3c1e857fd6c4987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Creating volume 0629fb52-de83-40b9-bdae-c2c9d4eca5c4 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:52 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:52 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 1073741824 Jul 08 01:26:52 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bc0fbd-0d03-4ad9-954c-ef6793c9096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54883fa5-1fd1-4869-ba51-9a8ce073a747', 'volume_size': 1, 'source_volid': '2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72', 'source_volstatus': 'available'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc75feca-862d-445b-9bdb-e2ae0c82c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Volume volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 (54883fa5-1fd1-4869-ba51-9a8ce073a747): created successfully Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc75feca-862d-445b-9bdb-e2ae0c82c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (ebf088fd-cb17-409f-9c8f-c8bef783941d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f2fae1bd-ad80-4c7d-abec-0147c978395e tempest-VolumesGetTest-905710318 None] Created volume successfully. Jul 08 01:26:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:26:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:53 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:26:53 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:53 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 1073741824" returned: 0 in 1.260s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:54 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 Jul 08 01:26:54 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:54 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.323s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:26:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:26:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:26:55 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4" returned: 0 in 1.561s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] <== create_volume: return (2929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.933s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.380s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-666386095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3678c56b-b52e-4698-b3d6-e4a4e355162e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6cd89c1bb841989065421978485ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:52Z,use_quota=True,user_id='10d8a3f6cd604958a6962bcf2d163cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Creating volume 3678c56b-b52e-4698-b3d6-e4a4e355162e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:55 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae58a041-f2a8-4e15-b7d2-e87d3975f8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464e6129-a628-4c46-a81d-f93c0827be6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:55 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e 1073741824 Jul 08 01:26:55 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:55 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Volume volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 (0629fb52-de83-40b9-bdae-c2c9d4eca5c4): created successfully Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464e6129-a628-4c46-a81d-f93c0827be6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Flow 'volume_create_manager' (6fd0e7f5-dcbb-4f6b-9572-6609a63bcfa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bf0e76d6-0be6-4c6f-8704-07c28bb808b0 tempest-ServerRescueNegativeTestJSON-1191458096 None] Created volume successfully. Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (169329d4-5a5c-4a3d-9bb7-9f9d5f6af56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a8da93-8b2c-46a4-b31e-ba4f485e12c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a8da93-8b2c-46a4-b31e-ba4f485e12c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-6482438',display_name='tempest-VolumesGetTest-Volume-1722665789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1037d2c2-a90c-48d6-8962-1e5a8848aef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:56Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c09abe3-32b8-44a4-8efb-69e6840366e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c09abe3-32b8-44a4-8efb-69e6840366e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb8cd60-269f-4062-906f-718d4ed1aee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb8cd60-269f-4062-906f-718d4ed1aee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1037d2c2-a90c-48d6-8962-1e5a8848aef1', 'volume_name': 'volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9abc30-8b1d-4af3-bf96-a077e69a151a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9abc30-8b1d-4af3-bf96-a077e69a151a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3290f3f-56d5-4a8e-b403-4502c7f8b786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Volume 1037d2c2-a90c-48d6-8962-1e5a8848aef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1', 'volume_size': 1} Jul 08 01:26:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:56 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e 1073741824" returned: 0 in 1.210s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:56 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e Jul 08 01:26:56 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:57 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e" returned: 0 in 0.969s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.814s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-6482438',display_name='tempest-VolumesGetTest-Volume-1722665789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1037d2c2-a90c-48d6-8962-1e5a8848aef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:56Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Creating volume 1037d2c2-a90c-48d6-8962-1e5a8848aef1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:57 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5a5b8f-edb7-4bbb-9b0b-1bb60ee173c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3678c56b-b52e-4698-b3d6-e4a4e355162e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5de3523-bdc0-421e-869c-d8bf78a103a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:57 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Volume volume-3678c56b-b52e-4698-b3d6-e4a4e355162e (3678c56b-b52e-4698-b3d6-e4a4e355162e): created successfully Jul 08 01:26:57 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 1073741824 Jul 08 01:26:57 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5de3523-bdc0-421e-869c-d8bf78a103a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Flow 'volume_create_manager' (87cc112f-03c1-4fe7-b86e-65d4cd218554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-33749a69-03e6-42da-b98b-137d95e3cd17 tempest-VolumesTestJSON-1860422937 None] Created volume successfully. Jul 08 01:26:59 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 1073741824" returned: 0 in 1.340s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:59 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 Jul 08 01:26:59 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Flow 'volume_create_manager' (184bb81d-4c4a-488c-ba8a-a0eee1ab6474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83732987-87ad-4483-af71-e00d8b064186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83732987-87ad-4483-af71-e00d8b064186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1256275990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d945567b-c006-475f-a6b0-bde4d1efdb3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6cd89c1bb841989065421978485ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:00Z,use_quota=True,user_id='10d8a3f6cd604958a6962bcf2d163cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9a1063-7adc-4cc3-82df-5bfac7e6e73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9a1063-7adc-4cc3-82df-5bfac7e6e73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68994d73-5e5c-481a-9bfc-c9c790a0e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68994d73-5e5c-481a-9bfc-c9c790a0e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd945567b-c006-475f-a6b0-bde4d1efdb3f', 'volume_name': 'volume-d945567b-c006-475f-a6b0-bde4d1efdb3f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c24cdc7-5615-44b9-97bb-ed685b20a328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c24cdc7-5615-44b9-97bb-ed685b20a328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811f8361-2c64-44d8-88c8-25b23bfeaa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Volume d945567b-c006-475f-a6b0-bde4d1efdb3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d945567b-c006-475f-a6b0-bde4d1efdb3f', 'volume_size': 1} Jul 08 01:26:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:00 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1" returned: 0 in 1.198s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] <== create_volume: return (2614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.618s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1256275990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d945567b-c006-475f-a6b0-bde4d1efdb3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6cd89c1bb841989065421978485ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:00Z,use_quota=True,user_id='10d8a3f6cd604958a6962bcf2d163cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Creating volume d945567b-c006-475f-a6b0-bde4d1efdb3f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:00 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3290f3f-56d5-4a8e-b403-4502c7f8b786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa2cec1-1af8-4393-b075-5484b7e83e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:00 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f 1073741824 Jul 08 01:27:00 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Volume volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 (1037d2c2-a90c-48d6-8962-1e5a8848aef1): created successfully Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa2cec1-1af8-4393-b075-5484b7e83e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (169329d4-5a5c-4a3d-9bb7-9f9d5f6af56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-52754a82-3af5-4bdd-a7e1-ac92d70147f5 tempest-VolumesGetTest-905710318 None] Created volume successfully. Jul 08 01:27:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-1037d2c2-a90c-48d6-8962-1e5a8848aef1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Lock "cinder-1037d2c2-a90c-48d6-8962-1e5a8848aef1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-quobyte-1037d2c2-a90c-48d6-8962-1e5a8848aef1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-1037d2c2-a90c-48d6-8962-1e5a8848aef1" acquired by "delete_volume" :: waited 0.063s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3da3c4-e6cd-4226-897a-2b38b316fad5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:02 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 Jul 08 01:27:02 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:02 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f 1073741824" returned: 0 in 1.973s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:02 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f Jul 08 01:27:02 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:03 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1" returned: 0 in 1.198s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:03 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1 Jul 08 01:27:03 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:03 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f" returned: 0 in 1.031s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] <== create_volume: return (3101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.109s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811f8361-2c64-44d8-88c8-25b23bfeaa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d945567b-c006-475f-a6b0-bde4d1efdb3f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee9df58-4c8c-4332-9627-613f7ee1ceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Volume volume-d945567b-c006-475f-a6b0-bde4d1efdb3f (d945567b-c006-475f-a6b0-bde4d1efdb3f): created successfully Jul 08 01:27:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee9df58-4c8c-4332-9627-613f7ee1ceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Flow 'volume_create_manager' (184bb81d-4c4a-488c-ba8a-a0eee1ab6474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c3839c45-1410-4ec4-bc1e-7da441cfa29f tempest-VolumesTestJSON-1860422937 None] Created volume successfully. Jul 08 01:27:04 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1037d2c2-a90c-48d6-8962-1e5a8848aef1" returned: 0 in 0.944s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-1037d2c2-a90c-48d6-8962-1e5a8848aef1" released by "delete_volume" :: held 2.287s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:04 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Created reservations ['6a6b1ccf-a635-4c9c-9da4-0dcda8afb474', '74bc2a3e-6a9e-48dd-a487-f8c153c21308', '328b9dbf-7eed-4f3f-8fdd-cdc68afc4d31', 'd28c1d59-6f02-4a42-9e87-d7c2491731fb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:04 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:04 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Flow 'volume_create_manager' (2c0aab12-6f29-4cea-8e52-12c6bf2b59fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6ed4aa-fbe3-436f-b39d-c21d8e748228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6ed4aa-fbe3-436f-b39d-c21d8e748228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1975643161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58eaac6-9dff-47fd-b584-28affd1091a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6cd89c1bb841989065421978485ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:05Z,use_quota=True,user_id='10d8a3f6cd604958a6962bcf2d163cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2591e1a9-fc02-43b6-9412-c8665d4dacb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2591e1a9-fc02-43b6-9412-c8665d4dacb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca7d0ba-0b73-42d7-96f8-d47787b6825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca7d0ba-0b73-42d7-96f8-d47787b6825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58eaac6-9dff-47fd-b584-28affd1091a0', 'volume_name': 'volume-e58eaac6-9dff-47fd-b584-28affd1091a0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f068d6b8-bf70-43b5-ba77-09ecefb2c968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f068d6b8-bf70-43b5-ba77-09ecefb2c968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9b43a-b529-4b6b-95a8-f51f0547d6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Volume e58eaac6-9dff-47fd-b584-28affd1091a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58eaac6-9dff-47fd-b584-28affd1091a0', 'volume_size': 1} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1975643161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58eaac6-9dff-47fd-b584-28affd1091a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6cd89c1bb841989065421978485ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:05Z,use_quota=True,user_id='10d8a3f6cd604958a6962bcf2d163cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Creating volume e58eaac6-9dff-47fd-b584-28affd1091a0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:05 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:05 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0 1073741824 Jul 08 01:27:05 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-54883fa5-1fd1-4869-ba51-9a8ce073a747-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Lock "cinder-54883fa5-1fd1-4869-ba51-9a8ce073a747-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-quobyte-54883fa5-1fd1-4869-ba51-9a8ce073a747" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-54883fa5-1fd1-4869-ba51-9a8ce073a747" acquired by "delete_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6b0b57-599e-455f-8c0c-830c2eefbed6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:05 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.500s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Deleted volume successfully. Jul 08 01:27:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a6e0f827-f17a-454c-ae12-9375b5cf1fbf tempest-VolumesGetTest-905710318 None] Lock "cinder-1037d2c2-a90c-48d6-8962-1e5a8848aef1-delete_volume" released by "delete_volume" :: held 4.287s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:06 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 Jul 08 01:27:06 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:07 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0 1073741824" returned: 0 in 2.364s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:07 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747" returned: 0 in 1.956s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:07 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747 Jul 08 01:27:07 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:08 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0 Jul 08 01:27:08 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:09 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54883fa5-1fd1-4869-ba51-9a8ce073a747" returned: 0 in 1.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-54883fa5-1fd1-4869-ba51-9a8ce073a747" released by "delete_volume" :: held 3.945s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:09 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0" returned: 0 in 1.785s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] <== create_volume: return (4470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.478s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9b43a-b529-4b6b-95a8-f51f0547d6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58eaac6-9dff-47fd-b584-28affd1091a0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2ad0fd-e520-4b74-bf66-757f007b88bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Created reservations ['6bb99eed-4f52-4675-b56f-f2d0a7cc68f6', 'fb0599d5-93df-48b5-af67-5826b36f4210', '890f9624-0ece-4016-af83-28a478adb5d3', '9a7a6565-e4e0-45c5-8c3f-e85f36676a33'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Volume volume-e58eaac6-9dff-47fd-b584-28affd1091a0 (e58eaac6-9dff-47fd-b584-28affd1091a0): created successfully Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2ad0fd-e520-4b74-bf66-757f007b88bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Flow 'volume_create_manager' (2c0aab12-6f29-4cea-8e52-12c6bf2b59fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6ec68cc9-235e-472f-9272-dd51d8065961 tempest-VolumesTestJSON-1860422937 None] Created volume successfully. Jul 08 01:27:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:10 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:10 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Lock "cinder-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-quobyte-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" acquired by "delete_volume" :: waited 0.052s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5aae79-230a-4687-a913-03454a8e2659]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:11 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 Jul 08 01:27:11 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:11 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.631s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:11 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Deleted volume successfully. Jul 08 01:27:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdca6d2a-491f-40ec-a145-e14c377ae71f tempest-VolumesGetTest-905710318 None] Lock "cinder-54883fa5-1fd1-4869-ba51-9a8ce073a747-delete_volume" released by "delete_volume" :: held 6.338s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Acquiring lock "cinder-e58eaac6-9dff-47fd-b584-28affd1091a0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Lock "cinder-e58eaac6-9dff-47fd-b584-28affd1091a0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:13 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" returned: 0 in 2.202s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Acquiring lock "cinder-quobyte-e58eaac6-9dff-47fd-b584-28affd1091a0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:13 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72 Jul 08 01:27:13 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Lock "cinder-quobyte-e58eaac6-9dff-47fd-b584-28affd1091a0" acquired by "delete_volume" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d13afa-5401-4881-9f37-0bf6f7da46ea]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:13 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0 Jul 08 01:27:13 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:14 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" returned: 0 in 1.071s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72" released by "delete_volume" :: held 3.457s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:14 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0" returned: 0 in 1.066s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:14 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0 Jul 08 01:27:14 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Created reservations ['84d1daef-3dfc-4c8b-a10b-0554f1410e7e', 'c1b7c821-ad69-4419-be24-fba49dd63ef2', 'df64439b-6e1b-4fd4-8924-5952da6a1c78', 'bdf8a927-a4c6-4ec7-99b4-327848af3e77'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:14 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:14 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:15 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e58eaac6-9dff-47fd-b584-28affd1091a0" returned: 0 in 0.875s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Lock "cinder-quobyte-e58eaac6-9dff-47fd-b584-28affd1091a0" released by "delete_volume" :: held 1.985s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Created reservations ['c468891f-03f9-496f-a9f8-184aff206c3c', '08e7263b-9ab5-4e47-8337-8c726478322e', '7d7c4143-04ee-4cdb-94fb-4f11e28befff', '8a40568d-e0b6-4516-92bc-baae4d6fb14d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:15 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.870s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Deleted volume successfully. Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4acd8c7a-5166-4f11-8fe2-e443ed89cb8e tempest-VolumesGetTest-905710318 None] Lock "cinder-2fe9e2b1-a7cb-4bd8-9d86-9f0e50b53e72-delete_volume" released by "delete_volume" :: held 4.904s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:15 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:15 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:16 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.044s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:16 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Deleted volume successfully. Jul 08 01:27:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Acquiring lock "cinder-d945567b-c006-475f-a6b0-bde4d1efdb3f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a26e1b94-6723-44b6-a585-743429500959 tempest-VolumesTestJSON-1860422937 None] Lock "cinder-e58eaac6-9dff-47fd-b584-28affd1091a0-delete_volume" released by "delete_volume" :: held 3.609s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Lock "cinder-d945567b-c006-475f-a6b0-bde4d1efdb3f-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Acquiring lock "cinder-quobyte-d945567b-c006-475f-a6b0-bde4d1efdb3f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Lock "cinder-quobyte-d945567b-c006-475f-a6b0-bde4d1efdb3f" acquired by "delete_volume" :: waited 0.043s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0dc724-7249-4136-8071-8abe3b5d72a3]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:17 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f Jul 08 01:27:17 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:17 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (3c24e9ca-db58-45f2-82c3-0a5d3013bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21763814-c580-4854-afae-d20671c3cd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21763814-c580-4854-afae-d20671c3cd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-917960743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2b24ff-6258-4f99-a088-391e4388c7b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:18Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e595d88-559e-413b-91ae-f1e6f9ae1d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e595d88-559e-413b-91ae-f1e6f9ae1d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6a2464-73b9-4896-84d8-62827a7fd8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Acquiring lock "cinder-0629fb52-de83-40b9-bdae-c2c9d4eca5c4-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "cinder-0629fb52-de83-40b9-bdae-c2c9d4eca5c4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Acquiring lock "cinder-quobyte-0629fb52-de83-40b9-bdae-c2c9d4eca5c4" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "cinder-quobyte-0629fb52-de83-40b9-bdae-c2c9d4eca5c4" acquired by "delete_volume" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8155e3de-f63d-4c92-99ac-7ea7499b74a6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:18 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 Jul 08 01:27:18 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:18 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f" returned: 0 in 1.522s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:18 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f Jul 08 01:27:18 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6a2464-73b9-4896-84d8-62827a7fd8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e2b24ff-6258-4f99-a088-391e4388c7b1', 'volume_name': 'volume-6e2b24ff-6258-4f99-a088-391e4388c7b1', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6244d9ef-1a9a-44c9-a4bb-63197a395a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6244d9ef-1a9a-44c9-a4bb-63197a395a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfca9ae-06fe-4206-9be5-e246d7091a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Volume 6e2b24ff-6258-4f99-a088-391e4388c7b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e2b24ff-6258-4f99-a088-391e4388c7b1', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:27:18 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Trying to clone 6e2b24ff-6258-4f99-a088-391e4388c7b1 from image 32b92798-e800-4287-a1ac-3d0d0779a37d at location (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:27:19 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:27:19 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:27:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8394fdfd-46fb-42dc-908b-f77b0085a47d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:19 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD Jul 08 01:27:19 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:19 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4" returned: 0 in 1.307s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:19 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d945567b-c006-475f-a6b0-bde4d1efdb3f" returned: 0 in 1.168s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:19 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4 Jul 08 01:27:19 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Lock "cinder-quobyte-d945567b-c006-475f-a6b0-bde4d1efdb3f" released by "delete_volume" :: held 2.760s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Created reservations ['433293e9-5a95-41ce-a199-0693ac9ff0fc', '6c6f8fb5-5511-4fa7-8106-7654d09c1620', '55d39ce7-1e1d-4fd1-9042-fa89770a087f', 'f10be485-4398-4b57-abd0-8af5b39f9a9e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:20 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:20 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Acquiring lock "cinder-3678c56b-b52e-4698-b3d6-e4a4e355162e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Lock "cinder-3678c56b-b52e-4698-b3d6-e4a4e355162e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:20 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD" returned: 0 in 1.229s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Temporary image 32b92798-e800-4287-a1ac-3d0d0779a37d is fetched for user 313e59f99498442b949a0f7fc5faab1e. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:27:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Acquiring lock "cinder-quobyte-3678c56b-b52e-4698-b3d6-e4a4e355162e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Lock "cinder-quobyte-3678c56b-b52e-4698-b3d6-e4a4e355162e" acquired by "delete_volume" :: waited 0.050s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45e4a04-1e8c-4cc0-a6df-649f0a6d19b4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c71703a-f1de-453c-94af-46956768eae1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:21 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0629fb52-de83-40b9-bdae-c2c9d4eca5c4" returned: 0 in 1.341s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "cinder-quobyte-0629fb52-de83-40b9-bdae-c2c9d4eca5c4" released by "delete_volume" :: held 2.756s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:21 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.130s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:21 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:21 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Deleted volume successfully. Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b402a6cc-dcda-4a4a-a4ac-fcf4c820b99f tempest-VolumesTestJSON-1860422937 None] Lock "cinder-d945567b-c006-475f-a6b0-bde4d1efdb3f-delete_volume" released by "delete_volume" :: held 4.379s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:21 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD Jul 08 01:27:21 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Created reservations ['dc981e5b-dae1-4656-b816-eed74324cfc4', '822d3a07-a659-4efa-9b00-e84f76522af4', '56b507fc-71d3-4678-9855-b83342797c26', 'b4ef42a9-22ac-46c7-b9bb-fdeb61231738'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:21 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:21 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:22 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e" returned: 0 in 1.179s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:22 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e Jul 08 01:27:22 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:22 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD" returned: 0 in 1.685s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-917960743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2b24ff-6258-4f99-a088-391e4388c7b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:18Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Creating volume 6e2b24ff-6258-4f99-a088-391e4388c7b1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:22 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:22 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.340s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Deleted volume successfully. Jul 08 01:27:22 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 1073741824 Jul 08 01:27:22 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc101be7-dc8d-4c32-8bd8-6ddb5f6ab764 tempest-ServerRescueNegativeTestJSON-1191458096 None] Lock "cinder-0629fb52-de83-40b9-bdae-c2c9d4eca5c4-delete_volume" released by "delete_volume" :: held 4.585s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:23 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3678c56b-b52e-4698-b3d6-e4a4e355162e" returned: 0 in 1.003s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Lock "cinder-quobyte-3678c56b-b52e-4698-b3d6-e4a4e355162e" released by "delete_volume" :: held 2.280s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Created reservations ['f85dfcbc-f2f4-4211-98fd-4fe652d39459', '563d1031-bc87-4d5f-9165-ece67c7b1b03', '5876857b-13b7-4b41-aca4-e61c390c6a81', '82dd3c15-ad70-4ed6-9f92-7ca5cc5b09f1'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:23 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:23 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:23 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 1073741824" returned: 0 in 1.125s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:24 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 Jul 08 01:27:24 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:24 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.202s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:24 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Deleted volume successfully. Jul 08 01:27:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-52fd5fc0-1d97-434b-9479-d47a492ff65d tempest-VolumesTestJSON-1860422937 None] Lock "cinder-3678c56b-b52e-4698-b3d6-e4a4e355162e-delete_volume" released by "delete_volume" :: held 3.934s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:25 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1" returned: 0 in 1.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] <== create_volume: return (2940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.956s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:25 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Attempting download of 32b92798-e800-4287-a1ac-3d0d0779a37d ((None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}])) to volume 6e2b24ff-6258-4f99-a088-391e4388c7b1. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:27:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[41957257-81c3-4b49-8107-834333a7f738]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_jaavm71p {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:26 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_jaavm71p Jul 08 01:27:26 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:27 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_jaavm71p" returned: 0 in 1.269s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_jaavm71p {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:27 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_jaavm71p Jul 08 01:27:27 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:28 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_jaavm71p" returned: 1 in 1.211s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_jaavm71p' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:27:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0a6530-d340-4c93-9b59-ab547ebdf02e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:28 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD Jul 08 01:27:28 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Flow 'volume_create_manager' (07bd96ec-7a47-4a5d-a267-c597e90880b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ea787f-0cf3-429c-b1c4-abf698a269dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ea787f-0cf3-429c-b1c4-abf698a269dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-674008351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b49b64-4e7d-4328-93d2-d7898f52c8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e9e6ae08ce4a718e5ae765e6c2ac2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:29Z,use_quota=True,user_id='c7632b2b165f48d397d6eeab78f0687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1507bc-874d-4383-a4cb-8027b2635346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1507bc-874d-4383-a4cb-8027b2635346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188264d1-3b8f-4d08-8e11-243cdbc39b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188264d1-3b8f-4d08-8e11-243cdbc39b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b49b64-4e7d-4328-93d2-d7898f52c8f2', 'volume_name': 'volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d00a2-d357-417c-8a74-ca4bb50c5fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d00a2-d357-417c-8a74-ca4bb50c5fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9708cbe-2b25-4703-b3e7-c5ba702280e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Volume f4b49b64-4e7d-4328-93d2-d7898f52c8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2', 'volume_size': 1} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-674008351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b49b64-4e7d-4328-93d2-d7898f52c8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e9e6ae08ce4a718e5ae765e6c2ac2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:29Z,use_quota=True,user_id='c7632b2b165f48d397d6eeab78f0687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Creating volume f4b49b64-4e7d-4328-93d2-d7898f52c8f2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:29 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:29 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 1073741824 Jul 08 01:27:29 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:29 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD" returned: 0 in 1.317s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] 32b92798-e800-4287-a1ac-3d0d0779a37d was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:27:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:29 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 Jul 08 01:27:29 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:31 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 1073741824" returned: 0 in 1.447s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:31 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 Jul 08 01:27:31 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:32 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2" returned: 0 in 1.106s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] <== create_volume: return (2630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.635s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9708cbe-2b25-4703-b3e7-c5ba702280e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cce1acd-70b4-49cb-bcc9-eb846edfbccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Volume volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 (f4b49b64-4e7d-4328-93d2-d7898f52c8f2): created successfully Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cce1acd-70b4-49cb-bcc9-eb846edfbccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Flow 'volume_create_manager' (07bd96ec-7a47-4a5d-a267-c597e90880b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c195255d-d5b1-4733-8447-adc1abd7b119 tempest-AttachVolumeNegativeTest-1709776555 None] Created volume successfully. Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-38467e44-79f7-4947-aa49-21847e809fb2 tempest-BackendsCapabilitiesAdminTestsJSON-1654724197 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5856590270996, 'free_capacity_gb': 1775.5856590270996, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87204) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:27:32 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1" returned: 0 in 3.173s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_rhlk2ciydevstack@QuobyteHD, size 112.00 MB, duration 3.17 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:27:32 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Converted 112.00 MB image at 35.28 MB/s Jul 08 01:27:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:32 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 1G Jul 08 01:27:32 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9672f35e-9ed9-4b41-a3d2-42ff556de7eb tempest-BackendsCapabilitiesAdminTestsJSON-1654724197 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5856590270996, 'free_capacity_gb': 1775.5856590270996, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87204) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:27:33 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 1G" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae973a7-2611-4b46-af71-4d8eff4d0c66]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:34 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 Jul 08 01:27:34 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:34 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1" returned: 0 in 0.873s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:34 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 Jul 08 01:27:34 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:35 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1" returned: 1 in 0.898s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Downloaded image 32b92798-e800-4287-a1ac-3d0d0779a37d ((None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}])) to volume 6e2b24ff-6258-4f99-a088-391e4388c7b1 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Temporary image 32b92798-e800-4287-a1ac-3d0d0779a37d for user 313e59f99498442b949a0f7fc5faab1e is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Marking volume 6e2b24ff-6258-4f99-a088-391e4388c7b1 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Copying metadata from image 32b92798-e800-4287-a1ac-3d0d0779a37d to 6e2b24ff-6258-4f99-a088-391e4388c7b1. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Creating volume glance metadata for volume 6e2b24ff-6258-4f99-a088-391e4388c7b1 backed by image 32b92798-e800-4287-a1ac-3d0d0779a37d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfca9ae-06fe-4206-9be5-e246d7091a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2b24ff-6258-4f99-a088-391e4388c7b1', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664fc0ac-b214-4bf6-93ff-4b6c8863d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:35 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Volume volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 (6e2b24ff-6258-4f99-a088-391e4388c7b1): created successfully Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664fc0ac-b214-4bf6-93ff-4b6c8863d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (3c24e9ca-db58-45f2-82c3-0a5d3013bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-585082bb-3bad-4c4e-b85e-cedd82acc3ae tempest-VolumesGetTest-905710318 None] Created volume successfully. Jul 08 01:27:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-4427a298-30be-4e1f-b11f-75241f28f128 req-d388f167-d493-4706-a69c-0a8d79fc5315 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-4427a298-30be-4e1f-b11f-75241f28f128 req-d388f167-d493-4706-a69c-0a8d79fc5315 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd81de7-438e-41e5-ae94-193fcc0694c6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-4427a298-30be-4e1f-b11f-75241f28f128 req-d388f167-d493-4706-a69c-0a8d79fc5315 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:36 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 Jul 08 01:27:36 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:37 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-4427a298-30be-4e1f-b11f-75241f28f128 req-d388f167-d493-4706-a69c-0a8d79fc5315 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2" returned: 0 in 0.912s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-4427a298-30be-4e1f-b11f-75241f28f128 req-d388f167-d493-4706-a69c-0a8d79fc5315 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-4427a298-30be-4e1f-b11f-75241f28f128 req-d388f167-d493-4706-a69c-0a8d79fc5315 tempest-AttachVolumeNegativeTest-1709776555 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '052b203c-226d-41e7-866a-4b6b28c182ec', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:27:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-4427a298-30be-4e1f-b11f-75241f28f128 req-d388f167-d493-4706-a69c-0a8d79fc5315 tempest-AttachVolumeNegativeTest-1709776555 None] attachment_update completed successfully. Jul 08 01:27:37 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (27130713-8569-45a3-b6ba-48b04022b392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f2fdf0-d01a-4809-85ea-ef1f2b11b6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f2fdf0-d01a-4809-85ea-ef1f2b11b6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-18710439',display_name='tempest-VolumesGetTest-Volume-575816912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed6b1fc-03ca-4824-9d02-4c7f3bac6808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:38Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdbc074-f26f-49e1-ba1b-4b51f588416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdbc074-f26f-49e1-ba1b-4b51f588416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7007b30b-a078-4546-bc62-b877df99a3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7007b30b-a078-4546-bc62-b877df99a3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed6b1fc-03ca-4824-9d02-4c7f3bac6808', 'volume_name': 'volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8353a5-2859-4109-af6b-470ab38ae171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8353a5-2859-4109-af6b-470ab38ae171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bf6319-ab44-4eac-8fcf-80f92bef2029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:38 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Volume 9ed6b1fc-03ca-4824-9d02-4c7f3bac6808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808', 'volume_size': 1} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-18710439',display_name='tempest-VolumesGetTest-Volume-575816912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed6b1fc-03ca-4824-9d02-4c7f3bac6808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6932561c27544ed8a84bd97ff4f1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:38Z,use_quota=True,user_id='313e59f99498442b949a0f7fc5faab1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Creating volume 9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:38 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:27:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:38 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 1073741824 Jul 08 01:27:38 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:39 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 1073741824" returned: 0 in 1.115s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:39 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 Jul 08 01:27:39 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:39 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808" returned: 0 in 0.725s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bf6319-ab44-4eac-8fcf-80f92bef2029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d5249a-4dd6-4a83-bfdd-2e5e8d1a8df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Volume volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 (9ed6b1fc-03ca-4824-9d02-4c7f3bac6808): created successfully Jul 08 01:27:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d5249a-4dd6-4a83-bfdd-2e5e8d1a8df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Flow 'volume_create_manager' (27130713-8569-45a3-b6ba-48b04022b392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-262aac0d-edf7-46ba-b80e-811bb108e00e tempest-VolumesGetTest-905710318 None] Created volume successfully. Jul 08 01:27:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Lock "cinder-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-quobyte-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88b0444-8b72-4ca9-aa76-748400a8c151]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:41 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 Jul 08 01:27:41 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:42 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808" returned: 0 in 1.059s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:42 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808 Jul 08 01:27:42 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:43 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808" returned: 0 in 0.967s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808" released by "delete_volume" :: held 2.089s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=86,cinder:SELECT=64,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Created reservations ['7225d03e-34b3-4470-a856-bde2872413b2', '57bb25a0-5f52-4a0f-8359-ba5e0aa2cd46', '03f3afc1-b172-408d-ad11-7186096c52d0', '1f83a71c-1c0f-47a9-b56e-8a0650bb11aa'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:44 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:44 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-e4db224a-b4c7-40e9-a2ee-dd63e9035e1a req-69de0a34-b7b7-4b1a-93a6-84c55750d8ae tempest-AttachVolumeNegativeTest-1709776555 None] Terminate volume connection completed successfully. Jul 08 01:27:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-e4db224a-b4c7-40e9-a2ee-dd63e9035e1a req-69de0a34-b7b7-4b1a-93a6-84c55750d8ae tempest-AttachVolumeNegativeTest-1709776555 None] Deleting attachment 052b203c-226d-41e7-866a-4b6b28c182ec. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:27:44 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.920s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:44 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Deleted volume successfully. Jul 08 01:27:44 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=99,cinder:SELECT=74,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:27:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a64e470-1d43-47b4-b34f-0cf873dd6191 tempest-VolumesGetTest-905710318 None] Lock "cinder-9ed6b1fc-03ca-4824-9d02-4c7f3bac6808-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-6e2b24ff-6258-4f99-a088-391e4388c7b1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Lock "cinder-6e2b24ff-6258-4f99-a088-391e4388c7b1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Acquiring lock "cinder-quobyte-6e2b24ff-6258-4f99-a088-391e4388c7b1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-6e2b24ff-6258-4f99-a088-391e4388c7b1" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cdb7b3-8636-4053-9244-3c6240b3e994]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:45 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 Jul 08 01:27:45 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:46 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1" returned: 0 in 0.984s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:46 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 Jul 08 01:27:46 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:47 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1" returned: 1 in 1.416s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:27:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:47 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1 Jul 08 01:27:47 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:48 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6e2b24ff-6258-4f99-a088-391e4388c7b1" returned: 0 in 0.823s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Lock "cinder-quobyte-6e2b24ff-6258-4f99-a088-391e4388c7b1" released by "delete_volume" :: held 3.312s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Created reservations ['e49d26b6-de10-4689-ac47-ae6b149fc192', '6fd8db67-131c-4a5e-a9e5-627963814a9e', 'f06aa69f-903b-450d-9168-8a8ef8be1b6d', 'f1326f5b-26c3-4c50-acf4-c6af8f3f546d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:48 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:48 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:49 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.960s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Deleted volume successfully. Jul 08 01:27:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7606a219-0741-4902-81cd-3c6988a3ba13 tempest-VolumesGetTest-905710318 None] Lock "cinder-6e2b24ff-6258-4f99-a088-391e4388c7b1-delete_volume" released by "delete_volume" :: held 4.580s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:27:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:53 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:53 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:54 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.962s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:27:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:27:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:27:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e1dc1eca-0db9-4790-9280-d7df807319d4 tempest-GroupsTest-1224606419 None] Group tempest-Group1-303226551: creating Jul 08 01:27:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e1dc1eca-0db9-4790-9280-d7df807319d4 tempest-GroupsTest-1224606419 None] Group tempest-Group1-303226551: created successfully Jul 08 01:27:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e1dc1eca-0db9-4790-9280-d7df807319d4 tempest-GroupsTest-1224606419 None] Create group completed successfully. Jul 08 01:27:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "cinder-f4b49b64-4e7d-4328-93d2-d7898f52c8f2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8373bf0d-ee11-408e-b1d3-cdee7c5db9d2 tempest-GroupsTest-1224606419 None] Group tempest-Group2-1932226625: creating Jul 08 01:27:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-f4b49b64-4e7d-4328-93d2-d7898f52c8f2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8373bf0d-ee11-408e-b1d3-cdee7c5db9d2 tempest-GroupsTest-1224606419 None] Group tempest-Group2-1932226625: created successfully Jul 08 01:27:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8373bf0d-ee11-408e-b1d3-cdee7c5db9d2 tempest-GroupsTest-1224606419 None] Create group completed successfully. Jul 08 01:27:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "cinder-quobyte-f4b49b64-4e7d-4328-93d2-d7898f52c8f2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-quobyte-f4b49b64-4e7d-4328-93d2-d7898f52c8f2" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27a8933-08c0-4272-80e4-5674dfde4217]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:57 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 Jul 08 01:27:57 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Flow 'volume_create_manager' (649bcbfa-18f1-4959-a5a2-ff775599dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2c4e23-8249-4a57-8f4c-903dba0d1e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2c4e23-8249-4a57-8f4c-903dba0d1e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-683012656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2e4d7a-dfa8-497e-8d84-e81daa63e581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c64cd94d3aa94a09bc252f41b01decfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:58Z,use_quota=True,user_id='102a4d192f4f4dbba9f6bbdbf3e35723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bafa11-66eb-4eb7-a175-df819e0eee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bafa11-66eb-4eb7-a175-df819e0eee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1518718-3946-4b65-b65a-85574e3cc521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1518718-3946-4b65-b65a-85574e3cc521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2e4d7a-dfa8-497e-8d84-e81daa63e581', 'volume_name': 'volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6553e03a-2b47-43ce-9e7c-190f05c14344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6553e03a-2b47-43ce-9e7c-190f05c14344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f5905c-d186-4524-bc97-5d0a7a882c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Volume 7a2e4d7a-dfa8-497e-8d84-e81daa63e581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581', 'volume_size': 1} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-683012656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2e4d7a-dfa8-497e-8d84-e81daa63e581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c64cd94d3aa94a09bc252f41b01decfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:58Z,use_quota=True,user_id='102a4d192f4f4dbba9f6bbdbf3e35723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Creating volume 7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:58 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:58 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 1073741824 Jul 08 01:27:58 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:58 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2" returned: 0 in 0.966s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:58 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2 Jul 08 01:27:58 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Flow 'volume_create_manager' (f898b5ac-ceb2-4b0a-aba6-84d0eca52cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c49650f-6a33-4bd3-87f0-470866869f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c49650f-6a33-4bd3-87f0-470866869f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1220652963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8a55dcb-a5fc-447e-acf6-116ca5f2256d,host='devstack@QuobyteHD#QuobyteHD',id=e0352fc5-844d-4457-9a63-cc6cef090cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a380765256684e07b705d7de97f61079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:59Z,use_quota=True,user_id='27f45f75dae64a01ba8de0d9ff7d3ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63383cee-a2d5-4876-9d8d-3cf430c37768),volume_type_id=63383cee-a2d5-4876-9d8d-3cf430c37768)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1ed61f-390d-4ece-9485-e859d78da5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1ed61f-390d-4ece-9485-e859d78da5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8bbe00-5593-49f2-9dcf-1eb84f2fafb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8bbe00-5593-49f2-9dcf-1eb84f2fafb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0352fc5-844d-4457-9a63-cc6cef090cb9', 'volume_name': 'volume-e0352fc5-844d-4457-9a63-cc6cef090cb9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96752b40-fdb0-48d0-846e-60e7add2b3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96752b40-fdb0-48d0-846e-60e7add2b3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff801c70-2866-46f2-82a7-0aea9b45fedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Volume e0352fc5-844d-4457-9a63-cc6cef090cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0352fc5-844d-4457-9a63-cc6cef090cb9', 'volume_size': 1} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:59 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f4b49b64-4e7d-4328-93d2-d7898f52c8f2" returned: 0 in 1.021s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-quobyte-f4b49b64-4e7d-4328-93d2-d7898f52c8f2" released by "delete_volume" :: held 2.041s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Created reservations ['a9ee1c40-17bd-4660-8006-03762ee9d383', '1d15f96b-29c5-48ac-9025-19748e953131', '3cb06412-30db-45a4-842a-033e9dfa3b51', '511c7579-eb7a-4b21-ae17-1fe6760216b5'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:59 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 1073741824" returned: 0 in 1.294s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:59 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:27:59 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:59 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 Jul 08 01:27:59 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "cinder-c1f4f437-a9a7-450a-be40-276e3e00af50-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-c1f4f437-a9a7-450a-be40-276e3e00af50-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "cinder-quobyte-c1f4f437-a9a7-450a-be40-276e3e00af50" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-quobyte-c1f4f437-a9a7-450a-be40-276e3e00af50" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc7cd23-8c01-4586-ae29-239f80c0f600]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:00 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 Jul 08 01:28:00 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:00 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.003s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Deleted volume successfully. Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-445213b0-ca1e-4db9-a64a-a28423b317e5 tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-f4b49b64-4e7d-4328-93d2-d7898f52c8f2-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:00 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" returned: 0 in 1.016s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] <== create_volume: return (2369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.372s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8a55dcb-a5fc-447e-acf6-116ca5f2256d,created_at=2026-07-07T23:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1220652963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8a55dcb-a5fc-447e-acf6-116ca5f2256d,host='devstack@QuobyteHD#QuobyteHD',id=e0352fc5-844d-4457-9a63-cc6cef090cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a380765256684e07b705d7de97f61079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:59Z,use_quota=True,user_id='27f45f75dae64a01ba8de0d9ff7d3ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63383cee-a2d5-4876-9d8d-3cf430c37768),volume_type_id=63383cee-a2d5-4876-9d8d-3cf430c37768)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Creating volume e0352fc5-844d-4457-9a63-cc6cef090cb9 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:00 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f5905c-d186-4524-bc97-5d0a7a882c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:00 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 1073741824 Jul 08 01:28:00 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7141fb92-7019-42ba-b6cd-f8c7cadea886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Volume volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 (7a2e4d7a-dfa8-497e-8d84-e81daa63e581): created successfully Jul 08 01:28:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7141fb92-7019-42ba-b6cd-f8c7cadea886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Flow 'volume_create_manager' (649bcbfa-18f1-4959-a5a2-ff775599dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a521f771-3a70-40fb-a91d-afe1f36cc8c2 tempest-VolumesSnapshotListTestJSON-1065603357 None] Created volume successfully. Jul 08 01:28:01 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50" returned: 0 in 1.308s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:01 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50 Jul 08 01:28:01 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:02 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 1073741824" returned: 0 in 1.362s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:02 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 Jul 08 01:28:02 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:02 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c1f4f437-a9a7-450a-be40-276e3e00af50" returned: 0 in 1.014s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-quobyte-c1f4f437-a9a7-450a-be40-276e3e00af50" released by "delete_volume" :: held 2.395s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Created reservations ['9e6de35c-d765-498f-a1cc-d30fbe7546db', '2d031bba-a395-4c56-85e2-9e52bb8e4176', '5626ed56-4cd8-43f7-b818-9746c0768049', 'eb4051b1-9e64-41de-991d-da14a5d2e909'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:02 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:28:02 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:03 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.251s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.060s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff801c70-2866-46f2-82a7-0aea9b45fedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0352fc5-844d-4457-9a63-cc6cef090cb9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f1054a-4c04-4350-90fc-169a1bc8e12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Creating offline snapshot 1e0780ab-baa0-4ea3-9384-4ac5441c976e of volume 7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Volume volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 (e0352fc5-844d-4457-9a63-cc6cef090cb9): created successfully Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f1054a-4c04-4350-90fc-169a1bc8e12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Flow 'volume_create_manager' (f898b5ac-ceb2-4b0a-aba6-84d0eca52cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeff8985-78a4-424c-b726-a6566bd6a1e5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-17199860-8702-4062-8632-c771caf26e9c tempest-GroupsTest-1224606419 None] Created volume successfully. Jul 08 01:28:03 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 Jul 08 01:28:03 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:03 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.030s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Deleted volume successfully. Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bb7c8be-2ddc-4022-8fc9-405b7813fe8c tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-c1f4f437-a9a7-450a-be40-276e3e00af50-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "cinder-69407d62-9ce8-4797-89eb-1502dcef975d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-69407d62-9ce8-4797-89eb-1502dcef975d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "cinder-quobyte-69407d62-9ce8-4797-89eb-1502dcef975d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-quobyte-69407d62-9ce8-4797-89eb-1502dcef975d" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d77f29-c214-485b-92db-b2656ef80b37]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:04 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d Jul 08 01:28:04 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:04 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" returned: 0 in 1.016s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:04 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e 1G Jul 08 01:28:04 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:04 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d" returned: 0 in 0.890s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:04 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d Jul 08 01:28:04 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Acquiring lock "cinder-quobyte-e0352fc5-844d-4457-9a63-cc6cef090cb9" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Lock "cinder-quobyte-e0352fc5-844d-4457-9a63-cc6cef090cb9" acquired by "delete_volume" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:05 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e 1G" returned: 0 in 1.267s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47ba926-3042-41ef-88d3-51217ab7598a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:05 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e Jul 08 01:28:05 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:05 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 Jul 08 01:28:05 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:05 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-69407d62-9ce8-4797-89eb-1502dcef975d" returned: 0 in 0.968s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-quobyte-69407d62-9ce8-4797-89eb-1502dcef975d" released by "delete_volume" :: held 1.914s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Created reservations ['77cab165-7206-4fcf-8882-0daaad4022ad', '766067de-439f-48be-bfc1-2c4c51d23c5d', '86e12604-39b5-41b1-949e-36e251d3990e', '1f27439d-6768-48d7-8c6c-f429ef18e21b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:06 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:28:06 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:06 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9" returned: 0 in 1.262s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:06 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e" returned: 0 in 1.308s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:06 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e is being set with open permissions: ugo+rw Jul 08 01:28:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:06 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9 Jul 08 01:28:06 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:06 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e Jul 08 01:28:06 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:07 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.179s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:07 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Deleted volume successfully. Jul 08 01:28:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c408a51e-a2bd-4c89-ba25-ca37387bd77a tempest-AttachVolumeNegativeTest-1709776555 None] Lock "cinder-69407d62-9ce8-4797-89eb-1502dcef975d-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:07 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e" returned: 0 in 0.854s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:07 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0352fc5-844d-4457-9a63-cc6cef090cb9" returned: 0 in 0.952s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:07 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.info Jul 08 01:28:07 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Lock "cinder-quobyte-e0352fc5-844d-4457-9a63-cc6cef090cb9" released by "delete_volume" :: held 2.299s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:07 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Created reservations ['2aa90ee6-aaa5-479e-8587-345a1b1d9e13'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:08 devstack cinder-volume[87204]: WARNING cinder.quota [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1610993913 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1610993913, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:28:08 devstack cinder-volume[87204]: WARNING cinder.quota [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1610993913 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1610993913, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:28:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Created reservations ['88ca26ca-81b5-47a5-8d9a-0e6f49c5a691', '7f38bc76-c15e-4eee-8432-16b2b75c391b', '7d22f53b-ac29-4aaa-8886-eeb53d8d4c0e', '9e98528f-2d30-4d4a-88ca-be6b4653788b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:08 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:28:08 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:08 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.info" returned: 0 in 1.057s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:08 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.info is being set with open permissions: ugo+rw Jul 08 01:28:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:08 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.info Jul 08 01:28:08 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:09 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.868s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-794962ee-8025-4eb3-b955-38879a65c9b6 tempest-GroupsTest-1224606419 None] Delete group completed successfully. Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] Created reservations ['7312bd35-bce4-4ab4-8340-3aa6bf962878'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:09 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:28:09 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:09 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.info" returned: 0 in 0.965s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.680s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-36c5439a-b0f8-4702-bf9e-df7efe5d3154 tempest-VolumesSnapshotListTestJSON-1065603357 None] Create snapshot completed successfully Jul 08 01:28:10 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.739s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:10 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7cbf34a5-8f23-426a-87a6-a4a4ed48daf7 tempest-GroupsTest-1224606419 None] Delete group completed successfully. Jul 08 01:28:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Creating offline snapshot 950bb817-ee0d-49fd-8489-2dd82e9ec090 of volume 7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe002f9-d467-47c5-bb05-bd2bf7b0ebe1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:11 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e Jul 08 01:28:11 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-93f30315-77b1-4603-8bb5-0ece04813670 tempest-GroupsTest-1224606419 None] Group tempest-GroupsTest-Group-202887358: creating Jul 08 01:28:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-93f30315-77b1-4603-8bb5-0ece04813670 tempest-GroupsTest-1224606419 None] Group tempest-GroupsTest-Group-202887358: created successfully Jul 08 01:28:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-93f30315-77b1-4603-8bb5-0ece04813670 tempest-GroupsTest-1224606419 None] Create group completed successfully. Jul 08 01:28:12 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e" returned: 0 in 1.264s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:12 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 1G Jul 08 01:28:12 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:13 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Flow 'volume_create_manager' (575b0581-1e2a-4048-8132-65e136fc2e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b35824-2fed-4f45-9c3c-74d25d47f8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:14 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 1G" returned: 0 in 1.696s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b35824-2fed-4f45-9c3c-74d25d47f8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-49594596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bbbce1-ce38-419d-99ec-8a580871924d,host='devstack@QuobyteHD#QuobyteHD',id=6b39021a-7b72-42ef-a9ba-5c574e54dd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a380765256684e07b705d7de97f61079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:14Z,use_quota=True,user_id='27f45f75dae64a01ba8de0d9ff7d3ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83104b64-9b68-410f-98a7-e77d381f70b8),volume_type_id=83104b64-9b68-410f-98a7-e77d381f70b8)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:14 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 Jul 08 01:28:14 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f65e8f5-7c18-4cb9-b2ca-b3d26b7da91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f65e8f5-7c18-4cb9-b2ca-b3d26b7da91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e19d91e-3782-4513-9d86-146c3e6de580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e19d91e-3782-4513-9d86-146c3e6de580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b39021a-7b72-42ef-a9ba-5c574e54dd4a', 'volume_name': 'volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11518d30-48b2-4861-9a44-0815dfeea268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11518d30-48b2-4861-9a44-0815dfeea268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b780fa-4597-4d14-9a4d-cf70ac6b44b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:14 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Volume 6b39021a-7b72-42ef-a9ba-5c574e54dd4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a', 'volume_size': 1} Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:14 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:14 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 is being set with open permissions: ugo+rw Jul 08 01:28:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:14 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 Jul 08 01:28:14 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:15 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090" returned: 0 in 0.858s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.872s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28bbbce1-ce38-419d-99ec-8a580871924d,created_at=2026-07-07T23:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-49594596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bbbce1-ce38-419d-99ec-8a580871924d,host='devstack@QuobyteHD#QuobyteHD',id=6b39021a-7b72-42ef-a9ba-5c574e54dd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a380765256684e07b705d7de97f61079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:14Z,use_quota=True,user_id='27f45f75dae64a01ba8de0d9ff7d3ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83104b64-9b68-410f-98a7-e77d381f70b8),volume_type_id=83104b64-9b68-410f-98a7-e77d381f70b8)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Creating volume 6b39021a-7b72-42ef-a9ba-5c574e54dd4a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:15 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:28:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:15 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a 1073741824 Jul 08 01:28:15 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-60b33134-7288-4d41-a843-fb82a27231e5 tempest-VolumesSnapshotListTestJSON-1065603357 None] Create snapshot completed successfully Jul 08 01:28:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:17 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a 1073741824" returned: 0 in 1.222s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:17 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a Jul 08 01:28:17 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-89d32623-fc30-4297-a562-c1c6fb11cab5 tempest-GroupSnapshotsTest-1416704093 None] Group tempest-GroupSnapshotsTest-Group-1933040819: creating Jul 08 01:28:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-89d32623-fc30-4297-a562-c1c6fb11cab5 tempest-GroupSnapshotsTest-1416704093 None] Group tempest-GroupSnapshotsTest-Group-1933040819: created successfully Jul 08 01:28:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-89d32623-fc30-4297-a562-c1c6fb11cab5 tempest-GroupSnapshotsTest-1416704093 None] Create group completed successfully. Jul 08 01:28:17 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a" returned: 0 in 0.818s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.238s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Creating offline snapshot a2883020-9ac3-449a-a992-9052a8520242 of volume 7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b780fa-4597-4d14-9a4d-cf70ac6b44b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c896e682-6c7c-4355-b7e7-8a3d456f6e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0633fd4-e4c2-4b41-8030-54e6a7519472]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Volume volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a (6b39021a-7b72-42ef-a9ba-5c574e54dd4a): created successfully Jul 08 01:28:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c896e682-6c7c-4355-b7e7-8a3d456f6e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Flow 'volume_create_manager' (575b0581-1e2a-4048-8132-65e136fc2e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e74aa8d5-3825-49f2-b2d0-b28e482ca748 tempest-GroupsTest-1224606419 None] Created volume successfully. Jul 08 01:28:18 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 Jul 08 01:28:18 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:19 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090" returned: 0 in 1.161s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:19 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 1G Jul 08 01:28:19 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Flow 'volume_create_manager' (25431b7d-9b3a-4ca3-b1b1-697fae37aee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270af19b-d3e9-4462-8203-ec5df829b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Flow 'volume_create_manager' (c841bfdf-4c6a-476d-89eb-8454c4a6df97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6def92ad-0099-482c-8816-ebeeba7a4272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270af19b-d3e9-4462-8203-ec5df829b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-11706275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bbbce1-ce38-419d-99ec-8a580871924d,host='devstack@QuobyteHD#QuobyteHD',id=b7b3867d-3442-45b9-9993-4af23305060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a380765256684e07b705d7de97f61079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:20Z,use_quota=True,user_id='27f45f75dae64a01ba8de0d9ff7d3ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83104b64-9b68-410f-98a7-e77d381f70b8),volume_type_id=83104b64-9b68-410f-98a7-e77d381f70b8)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34f5c3d-0b74-4b45-a72b-c60a34b2da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34f5c3d-0b74-4b45-a72b-c60a34b2da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0e9fcb-9bb7-48f4-ae0d-ef1dc93eede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0e9fcb-9bb7-48f4-ae0d-ef1dc93eede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b3867d-3442-45b9-9993-4af23305060e', 'volume_name': 'volume-b7b3867d-3442-45b9-9993-4af23305060e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564a3420-fd3b-4899-a957-334e19530f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564a3420-fd3b-4899-a957-334e19530f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807b8b0c-50c1-4548-bd99-31f1cb6fd6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Volume b7b3867d-3442-45b9-9993-4af23305060e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b3867d-3442-45b9-9993-4af23305060e', 'volume_size': 1} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6def92ad-0099-482c-8816-ebeeba7a4272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-598900521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47cdc871-ae1a-4cdb-b494-4f8de7476dc5,host='devstack@QuobyteHD#QuobyteHD',id=196fabc7-6d07-468c-8ba1-01bec44d14c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e39ea47cfc44acb8f99643c68eb4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:20Z,use_quota=True,user_id='6abba7b2dbf4427cb11e002d9ee1b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8bd3a37-efb2-499f-a8ff-3dce087bc85a),volume_type_id=d8bd3a37-efb2-499f-a8ff-3dce087bc85a)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01576342-68ed-4fab-8fe5-6c7fd1539e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01576342-68ed-4fab-8fe5-6c7fd1539e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d50768-9e3a-4ee9-969c-db07f12c6b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d50768-9e3a-4ee9-969c-db07f12c6b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196fabc7-6d07-468c-8ba1-01bec44d14c0', 'volume_name': 'volume-196fabc7-6d07-468c-8ba1-01bec44d14c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca2ae2d-78ba-4a71-ab0c-d385cadec343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca2ae2d-78ba-4a71-ab0c-d385cadec343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d532c598-9479-40b9-801e-8f9bf1787196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Volume 196fabc7-6d07-468c-8ba1-01bec44d14c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196fabc7-6d07-468c-8ba1-01bec44d14c0', 'volume_size': 1} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:20 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 1G" returned: 0 in 1.161s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:20 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 Jul 08 01:28:20 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:21 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242" returned: 0 in 0.943s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:21 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 is being set with open permissions: ugo+rw Jul 08 01:28:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:21 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 Jul 08 01:28:21 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:22 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242" returned: 0 in 0.797s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.228s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.985s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28bbbce1-ce38-419d-99ec-8a580871924d,created_at=2026-07-07T23:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-11706275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bbbce1-ce38-419d-99ec-8a580871924d,host='devstack@QuobyteHD#QuobyteHD',id=b7b3867d-3442-45b9-9993-4af23305060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a380765256684e07b705d7de97f61079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:20Z,use_quota=True,user_id='27f45f75dae64a01ba8de0d9ff7d3ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83104b64-9b68-410f-98a7-e77d381f70b8),volume_type_id=83104b64-9b68-410f-98a7-e77d381f70b8)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Creating volume b7b3867d-3442-45b9-9993-4af23305060e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:22 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:28:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:22 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e 1073741824 Jul 08 01:28:22 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4b60fb35-2e4c-491f-b68b-bc65ed60c94a tempest-VolumesSnapshotListTestJSON-1065603357 None] Create snapshot completed successfully Jul 08 01:28:23 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e 1073741824" returned: 0 in 1.124s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:23 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e Jul 08 01:28:23 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-a2883020-9ac3-449a-a992-9052a8520242-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-a2883020-9ac3-449a-a992-9052a8520242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-quobyte-a2883020-9ac3-449a-a992-9052a8520242" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-a2883020-9ac3-449a-a992-9052a8520242" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Deleting offline snapshot a2883020-9ac3-449a-a992-9052a8520242 of volume 7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] snapshot_file for this snap is: volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[481b37ea-035c-4701-86ba-f943d1cf2cd4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:24 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e" returned: 0 in 0.999s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.154s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47cdc871-ae1a-4cdb-b494-4f8de7476dc5,created_at=2026-07-07T23:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-598900521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47cdc871-ae1a-4cdb-b494-4f8de7476dc5,host='devstack@QuobyteHD#QuobyteHD',id=196fabc7-6d07-468c-8ba1-01bec44d14c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e39ea47cfc44acb8f99643c68eb4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:20Z,use_quota=True,user_id='6abba7b2dbf4427cb11e002d9ee1b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8bd3a37-efb2-499f-a8ff-3dce087bc85a),volume_type_id=d8bd3a37-efb2-499f-a8ff-3dce087bc85a)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Creating volume 196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:24 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807b8b0c-50c1-4548-bd99-31f1cb6fd6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b3867d-3442-45b9-9993-4af23305060e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf66d4f-8adc-489d-bb6a-49aa6e16a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:24 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 1073741824 Jul 08 01:28:24 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Volume volume-b7b3867d-3442-45b9-9993-4af23305060e (b7b3867d-3442-45b9-9993-4af23305060e): created successfully Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf66d4f-8adc-489d-bb6a-49aa6e16a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Flow 'volume_create_manager' (25431b7d-9b3a-4ca3-b1b1-697fae37aee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-54d29bf4-3f55-49b6-a9c8-60732419cfda tempest-GroupsTest-1224606419 None] Created volume successfully. Jul 08 01:28:24 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 Jul 08 01:28:24 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:25 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242" returned: 0 in 1.299s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:25 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 1073741824" returned: 0 in 1.252s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b740ddb5-0a47-4b80-9381-0a82b4e72263]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:25 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 Jul 08 01:28:25 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:25 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 Jul 08 01:28:25 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1ae6f45a-4e01-4d57-8cc1-1e9e05435d6a tempest-GroupsTest-1224606419 None] Update group completed successfully. Jul 08 01:28:26 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0" returned: 0 in 1.004s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.337s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d532c598-9479-40b9-801e-8f9bf1787196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196fabc7-6d07-468c-8ba1-01bec44d14c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178de484-6f3c-4008-aef5-c8623bc8f93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Volume volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 (196fabc7-6d07-468c-8ba1-01bec44d14c0): created successfully Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178de484-6f3c-4008-aef5-c8623bc8f93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:26 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Flow 'volume_create_manager' (c841bfdf-4c6a-476d-89eb-8454c4a6df97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090" returned: 0 in 1.123s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-72640def-d895-4cb9-9dff-63f030620eff tempest-GroupSnapshotsTest-1416704093 None] Created volume successfully. Jul 08 01:28:26 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 Jul 08 01:28:26 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] GroupSnapshot 68fe8742-3b6e-4fb2-8100-64805129e2eb: creating. Jul 08 01:28:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Group snapshot 68fe8742-3b6e-4fb2-8100-64805129e2eb: creating. {{(pid=87204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:28:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Creating offline snapshot 940629c7-1013-4a06-9c56-802596642bb5 of volume 196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-98396a88-c10a-44bd-abac-3104dae71394 tempest-GroupsTest-1224606419 None] Update group completed successfully. Jul 08 01:28:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8c622-4afb-4212-9246-e9097c491070]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:27 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242" returned: 0 in 1.056s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:27 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242 Jul 08 01:28:27 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:27 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 Jul 08 01:28:27 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:28 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.a2883020-9ac3-449a-a992-9052a8520242" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-a2883020-9ac3-449a-a992-9052a8520242" released by "_delete_snapshot" :: held 4.354s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" released by "delete_snapshot" :: held 4.389s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:28 devstack cinder-volume[87204]: WARNING cinder.quota [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:28:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Created reservations ['76c9d1f2-ad63-4e24-9ead-9862f46dd3b9', 'a03c40bf-853b-45fd-9e58-3cea540428b7', 'cf119e67-accc-4e78-a9a1-dde8a1f72e82', '114fecd6-2e02-4004-b494-8dac5daad50a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:28 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0" returned: 0 in 0.889s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:28 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 1G Jul 08 01:28:28 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Delete snapshot completed successfully. Jul 08 01:28:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-74a2d00c-5971-4ef2-8178-010aa3e43295 tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-a2883020-9ac3-449a-a992-9052a8520242-delete_snapshot" released by "delete_snapshot" :: held 4.629s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Acquiring lock "cinder-quobyte-6b39021a-7b72-42ef-a9ba-5c574e54dd4a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Lock "cinder-quobyte-6b39021a-7b72-42ef-a9ba-5c574e54dd4a" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[994c4bb8-530c-493b-a342-06ac035ad453]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:29 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 1G" returned: 0 in 0.946s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:29 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 Jul 08 01:28:29 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a Jul 08 01:28:29 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:29 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-950bb817-ee0d-49fd-8489-2dd82e9ec090-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-950bb817-ee0d-49fd-8489-2dd82e9ec090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-quobyte-950bb817-ee0d-49fd-8489-2dd82e9ec090" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-950bb817-ee0d-49fd-8489-2dd82e9ec090" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Deleting offline snapshot 950bb817-ee0d-49fd-8489-2dd82e9ec090 of volume 7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] snapshot_file for this snap is: volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[01612c51-2e41-4fc0-ac1d-0c34139c87bd]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:30 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 Jul 08 01:28:30 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:30 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a" returned: 0 in 1.078s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:30 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a Jul 08 01:28:30 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:30 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5" returned: 0 in 1.064s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:30 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:28:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:30 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 Jul 08 01:28:30 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:31 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090" returned: 0 in 1.225s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[21764f55-835d-4204-9cf9-b742959d4c41]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:31 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e Jul 08 01:28:31 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:31 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:31 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.info Jul 08 01:28:31 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:31 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6b39021a-7b72-42ef-a9ba-5c574e54dd4a" returned: 0 in 1.030s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Lock "cinder-quobyte-6b39021a-7b72-42ef-a9ba-5c574e54dd4a" released by "delete_volume" :: held 2.182s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Acquiring lock "cinder-quobyte-b7b3867d-3442-45b9-9993-4af23305060e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Lock "cinder-quobyte-b7b3867d-3442-45b9-9993-4af23305060e" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bdaf09-3c76-4d04-9d9f-532b8e9d7c3a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:31 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e Jul 08 01:28:31 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:32 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e" returned: 0 in 1.084s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:32 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 Jul 08 01:28:32 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:32 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.info" returned: 0 in 0.984s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:32 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:28:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:32 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.info Jul 08 01:28:32 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:32 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e" returned: 0 in 1.018s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:32 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e Jul 08 01:28:32 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:33 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090" returned: 0 in 1.023s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:33 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090 Jul 08 01:28:33 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:33 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.info" returned: 0 in 0.792s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.673s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c3570300-dfa7-4cad-b724-e99529234bf6 tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 68fe8742-3b6e-4fb2-8100-64805129e2eb: created successfully Jul 08 01:28:33 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b7b3867d-3442-45b9-9993-4af23305060e" returned: 0 in 0.965s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Lock "cinder-quobyte-b7b3867d-3442-45b9-9993-4af23305060e" released by "delete_volume" :: held 2.050s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:33 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Created reservations ['74796cf8-820b-49f3-aa2f-8e2c76541822'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:33 devstack cinder-volume[87204]: WARNING cinder.quota [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-678447879 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-678447879, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:28:33 devstack cinder-volume[87204]: WARNING cinder.quota [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-678447879 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-678447879, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:28:33 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Created reservations ['31f6ea2c-56ea-41a5-b829-0e2a83d6818a', '6d222a2d-0517-48ce-9515-a679a7a62152', '954272c3-11f8-43b4-9543-2b58714ac086', 'c56b67a5-899c-4558-8ce2-5c4108dff0b5'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Created reservations ['7f641766-f7f1-4693-98f3-d61cce10fff9', 'b22db01b-63d0-41be-93c0-2d88315dfcde', '987d7db2-8a8b-4ce3-96e7-738985aa172f', '1c712c4f-34f0-4eaa-b8b7-b7c995d92701'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:34 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.950bb817-ee0d-49fd-8489-2dd82e9ec090" returned: 0 in 0.910s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-950bb817-ee0d-49fd-8489-2dd82e9ec090" released by "_delete_snapshot" :: held 4.364s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" released by "delete_snapshot" :: held 4.404s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:34 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:28:34 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Created reservations ['c61c663a-eab0-48ef-b37d-71ef09fd809f', 'c4c19620-1fe8-4aa6-b045-89222cf3f805', 'd84747de-b076-43aa-a483-ef2d6eeabaff', 'a6f4c12c-bffe-418f-b5e2-e47fd4cfb80e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Delete snapshot completed successfully. Jul 08 01:28:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f34ca8c0-3077-442d-8acc-3a5ab18805dd tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-950bb817-ee0d-49fd-8489-2dd82e9ec090-delete_snapshot" released by "delete_snapshot" :: held 4.598s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:35 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ebbe567b-522e-4bb2-883b-45728634c262 tempest-GroupsTest-1224606419 None] Delete group completed successfully. Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-1e0780ab-baa0-4ea3-9384-4ac5441c976e-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-1e0780ab-baa0-4ea3-9384-4ac5441c976e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-quobyte-1e0780ab-baa0-4ea3-9384-4ac5441c976e" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-1e0780ab-baa0-4ea3-9384-4ac5441c976e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Deleting offline snapshot 1e0780ab-baa0-4ea3-9384-4ac5441c976e of volume 7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] snapshot_file for this snap is: volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c1e18f-d4b6-4e96-a338-f05d6111a31b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-940629c7-1013-4a06-9c56-802596642bb5-a88020d0-3a76-478b-93c7-47ce99d49dbf" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-940629c7-1013-4a06-9c56-802596642bb5-a88020d0-3a76-478b-93c7-47ce99d49dbf" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Creating volume a88020d0-3a76-478b-93c7-47ce99d49dbf from snapshot 940629c7-1013-4a06-9c56-802596642bb5 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:35 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e Jul 08 01:28:35 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-a88020d0-3a76-478b-93c7-47ce99d49dbf" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-a88020d0-3a76-478b-93c7-47ce99d49dbf" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] snapshot: 940629c7-1013-4a06-9c56-802596642bb5, volume: a88020d0-3a76-478b-93c7-47ce99d49dbf, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[69182fa4-d0d0-4d8a-8373-1bd3f386398c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:35 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 Jul 08 01:28:35 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:36 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e" returned: 0 in 0.963s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d2d48-d0b6-4073-becd-f50e0740bd73]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:36 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 Jul 08 01:28:36 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:36 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5" returned: 0 in 0.963s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-196fabc7-6d07-468c-8ba1-01bec44d14c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2301097-708e-457b-8d5e-6fa950537ed3]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:36 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 Jul 08 01:28:36 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:37 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" returned: 0 in 0.957s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:37 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e Jul 08 01:28:37 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:37 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:37 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:28:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:37 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf Jul 08 01:28:37 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:38 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e" returned: 0 in 0.951s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:38 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e Jul 08 01:28:38 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:40 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581.1e0780ab-baa0-4ea3-9384-4ac5441c976e" returned: 0 in 1.820s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-1e0780ab-baa0-4ea3-9384-4ac5441c976e" released by "_delete_snapshot" :: held 4.894s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" released by "delete_snapshot" :: held 4.929s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:41 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Created reservations ['23dc0f43-d039-4dba-899b-15067ed8194e', '77bc1885-5560-4d5c-9d25-7fadb97f9fa3', 'cdf4cfca-130b-41d1-b3c1-77b3ea09d9a1', '58574305-0bb2-4b55-9c79-1dce233ce226'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Delete snapshot completed successfully. Jul 08 01:28:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b187bd49-060f-453c-b444-f8add74b8aef tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-1e0780ab-baa0-4ea3-9384-4ac5441c976e-delete_snapshot" released by "delete_snapshot" :: held 7.736s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:43 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf" returned: 0 in 5.480s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b17b44d-8261-4631-959b-824713d928bb]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-7a2e4d7a-dfa8-497e-8d84-e81daa63e581-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-7a2e4d7a-dfa8-497e-8d84-e81daa63e581-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:43 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 Jul 08 01:28:43 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[00079ae5-861e-40a6-88b6-8ff154d2f1e9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:43 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 Jul 08 01:28:43 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:44 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0" returned: 0 in 1.109s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:28:44 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Converted 1024.00 MB image at 186.77 MB/s Jul 08 01:28:44 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:44 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" returned: 0 in 0.837s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:44 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf Jul 08 01:28:44 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:44 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581 Jul 08 01:28:44 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:44 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf" returned: 0 in 0.677s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-a88020d0-3a76-478b-93c7-47ce99d49dbf" released by "_copy_volume_from_snapshot" :: held 9.307s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-940629c7-1013-4a06-9c56-802596642bb5-a88020d0-3a76-478b-93c7-47ce99d49dbf" released by "_create_volume_from_snapshot" :: held 9.361s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.400s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:44 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-quobyte-7a2e4d7a-dfa8-497e-8d84-e81daa63e581" released by "delete_volume" :: held 1.668s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=111,cinder:SELECT=114,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:44 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=92,cinder:UPDATE=109,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:45 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Created reservations ['80d4960d-a951-4880-9ff6-58dedb26fbe6', 'a43917ba-b329-447d-b34c-20dd32063f8c', '5165b3a4-e9ab-4d7a-9d86-81fb183a14d7', 'ac92bae3-be6d-47f1-bc7a-2980361e0fe5'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-295591c9-4d6d-4e64-b1ea-ebea9ccb59aa tempest-GroupSnapshotsTest-1416704093 None] Create group from source-snapshot-68fe8742-3b6e-4fb2-8100-64805129e2eb completed successfully. Jul 08 01:28:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:45 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:28:45 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Flow 'volume_create_manager' (8d6e574c-d85c-40b9-ace7-475c28a36d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee03e01-e6e9-406d-ae72-c46df88ea9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee03e01-e6e9-406d-ae72-c46df88ea9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-133133467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777b694c-963f-48f4-bdc6-d865600a39e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da55303bef94cbc86dd839b70e35df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:46Z,use_quota=True,user_id='26ad9305cd2c4c55bf27b143e54c36f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaf1e4d-0d30-4c31-9612-abdad892e445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaf1e4d-0d30-4c31-9612-abdad892e445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a42e2dc-4909-4b63-93a6-66de71f6154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a42e2dc-4909-4b63-93a6-66de71f6154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777b694c-963f-48f4-bdc6-d865600a39e6', 'volume_name': 'volume-777b694c-963f-48f4-bdc6-d865600a39e6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59af85db-59ac-4e2a-b87a-bbdf5d1e7494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59af85db-59ac-4e2a-b87a-bbdf5d1e7494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb38cd6-ca2f-49bf-82ae-d7dba26a3606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Volume 777b694c-963f-48f4-bdc6-d865600a39e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777b694c-963f-48f4-bdc6-d865600a39e6', 'volume_size': 1} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-133133467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777b694c-963f-48f4-bdc6-d865600a39e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da55303bef94cbc86dd839b70e35df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:46Z,use_quota=True,user_id='26ad9305cd2c4c55bf27b143e54c36f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Creating volume 777b694c-963f-48f4-bdc6-d865600a39e6 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:46 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:46 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.948s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:46 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6 1073741824 Jul 08 01:28:46 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Deleted volume successfully. Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f811ab42-8f44-4584-9069-da5f4da5fcca tempest-VolumesSnapshotListTestJSON-1065603357 None] Lock "cinder-7a2e4d7a-dfa8-497e-8d84-e81daa63e581-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-a88020d0-3a76-478b-93c7-47ce99d49dbf" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-a88020d0-3a76-478b-93c7-47ce99d49dbf" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4404d9-ce81-4322-9cb7-903a5feec6eb]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:46 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf Jul 08 01:28:46 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:47 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6 1073741824" returned: 0 in 1.131s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:47 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6 Jul 08 01:28:47 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:47 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf" returned: 0 in 1.060s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:47 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf Jul 08 01:28:47 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:48 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6" returned: 0 in 1.043s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] <== create_volume: return (2243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb38cd6-ca2f-49bf-82ae-d7dba26a3606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777b694c-963f-48f4-bdc6-d865600a39e6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb0a7b6-00ab-45ca-ae63-fdd5596dc66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Volume volume-777b694c-963f-48f4-bdc6-d865600a39e6 (777b694c-963f-48f4-bdc6-d865600a39e6): created successfully Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb0a7b6-00ab-45ca-ae63-fdd5596dc66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Flow 'volume_create_manager' (8d6e574c-d85c-40b9-ace7-475c28a36d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e136c269-ee6d-4c53-aa23-18ba0122792a tempest-AttachVolumeShelveTestJSON-1279836056 None] Created volume successfully. Jul 08 01:28:48 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a88020d0-3a76-478b-93c7-47ce99d49dbf" returned: 0 in 0.917s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-a88020d0-3a76-478b-93c7-47ce99d49dbf" released by "delete_volume" :: held 2.031s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['624eb7ce-bf96-4c53-8f16-58e2090ff45f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:48 devstack cinder-volume[87204]: WARNING cinder.quota [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1071047470 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1071047470, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:28:48 devstack cinder-volume[87204]: WARNING cinder.quota [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1071047470 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1071047470, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['e65e25c6-0e34-42f5-a6b3-5d19702aea18', '1a2567f8-eee9-4629-819a-d76a5a0c5e8b', '8374c6c1-b2e3-41c0-8442-4a1fafcda354', '31f5d8f0-4690-432e-aa8c-3e4b2617e1a6'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:48 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:28:48 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 68fe8742-3b6e-4fb2-8100-64805129e2eb: deleting Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 68fe8742-3b6e-4fb2-8100-64805129e2eb: deleting {{(pid=87204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-196fabc7-6d07-468c-8ba1-01bec44d14c0" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-196fabc7-6d07-468c-8ba1-01bec44d14c0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-940629c7-1013-4a06-9c56-802596642bb5" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-940629c7-1013-4a06-9c56-802596642bb5" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Deleting offline snapshot 940629c7-1013-4a06-9c56-802596642bb5 of volume 196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] snapshot_file for this snap is: volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aba1fc-1c6c-4eca-9008-44427e7aa3d2]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:49 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 Jul 08 01:28:49 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:49 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.084s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bd611cc2-7490-437a-82e0-7904d5464a75 tempest-GroupSnapshotsTest-1416704093 None] Delete group completed successfully. Jul 08 01:28:50 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5" returned: 0 in 1.177s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-196fabc7-6d07-468c-8ba1-01bec44d14c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71155db-a348-4ff9-a4ca-2c2147ba5597]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:50 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 Jul 08 01:28:50 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:51 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0" returned: 0 in 1.193s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:51 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 Jul 08 01:28:51 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:52 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5" returned: 0 in 0.883s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:52 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5 Jul 08 01:28:52 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:53 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:28:53 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:53 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0.940629c7-1013-4a06-9c56-802596642bb5" returned: 0 in 1.018s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-940629c7-1013-4a06-9c56-802596642bb5" released by "_delete_snapshot" :: held 4.482s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-196fabc7-6d07-468c-8ba1-01bec44d14c0" released by "delete_snapshot" :: held 4.531s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:54 devstack cinder-volume[87204]: WARNING cinder.quota [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1071047470 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1071047470, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:28:54 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['05aa15cc-d94f-4c35-9e33-633cbddf01b2', 'f0984f44-45b0-402d-b3b1-7f00aad8ed1c', '6d42ff7d-dc6c-40e7-af3e-8804b7f10eba', '8c4f10cd-505c-4434-bbfc-3e9b5ce8d641'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-77c981e8-24cd-48aa-990b-2d08fc89169d tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 68fe8742-3b6e-4fb2-8100-64805129e2eb: deleted successfully Jul 08 01:28:54 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.078s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:28:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:28:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:28:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-196fabc7-6d07-468c-8ba1-01bec44d14c0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-196fabc7-6d07-468c-8ba1-01bec44d14c0" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8bc401-278a-42f6-a812-4dba32ed8f51]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:55 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 Jul 08 01:28:55 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:56 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0" returned: 0 in 1.405s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:56 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0 Jul 08 01:28:56 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Flow 'volume_create_manager' (767fb6aa-e4be-48ea-9667-d455e034ff1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c760312a-b48a-4c66-87ec-c4bb4b98f125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c760312a-b48a-4c66-87ec-c4bb4b98f125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-539643638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a2e1e2-d160-4eec-b772-5beb22fb0db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d9bb4623be42838d0727f204ffb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:57Z,use_quota=True,user_id='ffe725a62fb14083af31f52301d374cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51660ff0-53db-44e5-941c-70c95ce6a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51660ff0-53db-44e5-941c-70c95ce6a19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e64086-24c7-4294-b01d-5ec59401929c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e64086-24c7-4294-b01d-5ec59401929c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a2e1e2-d160-4eec-b772-5beb22fb0db5', 'volume_name': 'volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8032c664-6cd2-4b59-8dc0-9046fa3b8c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8032c664-6cd2-4b59-8dc0-9046fa3b8c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1264f7cd-5fa8-465a-995b-121c8b3fc01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:57 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Volume a8a2e1e2-d160-4eec-b772-5beb22fb0db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5', 'volume_size': 1} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-539643638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a2e1e2-d160-4eec-b772-5beb22fb0db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d9bb4623be42838d0727f204ffb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:57Z,use_quota=True,user_id='ffe725a62fb14083af31f52301d374cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Creating volume a8a2e1e2-d160-4eec-b772-5beb22fb0db5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:57 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:28:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:57 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 1073741824 Jul 08 01:28:57 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:57 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-196fabc7-6d07-468c-8ba1-01bec44d14c0" returned: 0 in 1.209s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-196fabc7-6d07-468c-8ba1-01bec44d14c0" released by "delete_volume" :: held 2.739s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['f3630cba-40eb-4754-b95b-bd45731ca608'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:58 devstack cinder-volume[87204]: WARNING cinder.db.api [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1071047470'] Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['093bd61d-d693-40c5-92da-d4580249a00c', '662125bc-2cde-4c69-a29d-813c6c7777bb', '193160ec-4a5b-4496-a3b0-64d7c9c08eb7', '315324de-3fa3-4e62-93e7-860bb0b1d1df'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:58 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:28:58 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:58 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 1073741824" returned: 0 in 1.509s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:59 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 Jul 08 01:28:59 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:59 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.264s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:59 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-573123b0-524c-41f8-8527-f6c20bb43e94 tempest-GroupSnapshotsTest-1416704093 None] Delete group completed successfully. Jul 08 01:29:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-af37afe2-5200-4baa-8b5c-1992908d0401 tempest-GroupSnapshotsTest-1416704093 None] Group tempest-GroupSnapshotsTest-Group-1756961036: creating Jul 08 01:29:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-af37afe2-5200-4baa-8b5c-1992908d0401 tempest-GroupSnapshotsTest-1416704093 None] Group tempest-GroupSnapshotsTest-Group-1756961036: created successfully Jul 08 01:29:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-af37afe2-5200-4baa-8b5c-1992908d0401 tempest-GroupSnapshotsTest-1416704093 None] Create group completed successfully. Jul 08 01:29:00 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5" returned: 0 in 1.268s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] <== create_volume: return (2863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.866s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1264f7cd-5fa8-465a-995b-121c8b3fc01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a4f402-f25c-4aec-b77d-3f147a52a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Volume volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 (a8a2e1e2-d160-4eec-b772-5beb22fb0db5): created successfully Jul 08 01:29:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a4f402-f25c-4aec-b77d-3f147a52a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Flow 'volume_create_manager' (767fb6aa-e4be-48ea-9667-d455e034ff1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-35750ae8-0033-4369-b1bf-82440ed63e91 tempest-VolumeQuotasAdminTestJSON-375991351 None] Created volume successfully. Jul 08 01:29:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Acquiring lock "cinder-a8a2e1e2-d160-4eec-b772-5beb22fb0db5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "cinder-a8a2e1e2-d160-4eec-b772-5beb22fb0db5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Acquiring lock "cinder-quobyte-a8a2e1e2-d160-4eec-b772-5beb22fb0db5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "cinder-quobyte-a8a2e1e2-d160-4eec-b772-5beb22fb0db5" acquired by "delete_volume" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f3d1ef-67be-442f-96eb-eb285505ab94]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:02 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 Jul 08 01:29:02 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Flow 'volume_create_manager' (957545d6-3a4b-4589-9918-a7067ace5196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341a8514-0a55-4e57-93a9-4663598146c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341a8514-0a55-4e57-93a9-4663598146c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621890872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=091d732e-f78a-49a4-94a6-725cf9e57988,host='devstack@QuobyteHD#QuobyteHD',id=20c93464-875a-47d6-9533-f45a944558f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e39ea47cfc44acb8f99643c68eb4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:02Z,use_quota=True,user_id='6abba7b2dbf4427cb11e002d9ee1b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ae3dc9-7a33-4973-8098-502881552c18),volume_type_id=d4ae3dc9-7a33-4973-8098-502881552c18)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f3fb87-b3c1-4ee7-a3a5-677670c23460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f3fb87-b3c1-4ee7-a3a5-677670c23460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b619f3c5-4c03-462e-83bf-11b172e38299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b619f3c5-4c03-462e-83bf-11b172e38299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c93464-875a-47d6-9533-f45a944558f0', 'volume_name': 'volume-20c93464-875a-47d6-9533-f45a944558f0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfc753f-41f9-4620-9e3d-c9b9a3a82f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfc753f-41f9-4620-9e3d-c9b9a3a82f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b5275c-14c1-4707-8daf-0254eeb28ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Volume 20c93464-875a-47d6-9533-f45a944558f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c93464-875a-47d6-9533-f45a944558f0', 'volume_size': 1} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=091d732e-f78a-49a4-94a6-725cf9e57988,created_at=2026-07-07T23:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621890872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=091d732e-f78a-49a4-94a6-725cf9e57988,host='devstack@QuobyteHD#QuobyteHD',id=20c93464-875a-47d6-9533-f45a944558f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e39ea47cfc44acb8f99643c68eb4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:02Z,use_quota=True,user_id='6abba7b2dbf4427cb11e002d9ee1b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ae3dc9-7a33-4973-8098-502881552c18),volume_type_id=d4ae3dc9-7a33-4973-8098-502881552c18)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Creating volume 20c93464-875a-47d6-9533-f45a944558f0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:02 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:02 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 1073741824 Jul 08 01:29:02 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:02 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5" returned: 0 in 1.000s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:02 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5 Jul 08 01:29:02 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:03 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 1073741824" returned: 0 in 1.351s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:03 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 Jul 08 01:29:03 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:04 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a8a2e1e2-d160-4eec-b772-5beb22fb0db5" returned: 0 in 1.161s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "cinder-quobyte-a8a2e1e2-d160-4eec-b772-5beb22fb0db5" released by "delete_volume" :: held 2.229s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Created reservations ['d5c572e2-2300-4400-9613-d9b59a12609f', '73a32b9e-5266-4b0b-af3f-cefb06789cb7', 'e1b350f5-b170-4043-80da-cc115ffc3606', '8e449c9a-97b7-442c-8280-a827bd2809f5'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:04 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:29:04 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:04 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0" returned: 0 in 0.891s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] <== create_volume: return (2321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b5275c-14c1-4707-8daf-0254eeb28ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c93464-875a-47d6-9533-f45a944558f0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e11b1df-e47e-4849-9500-57a5c7402fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Volume volume-20c93464-875a-47d6-9533-f45a944558f0 (20c93464-875a-47d6-9533-f45a944558f0): created successfully Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e11b1df-e47e-4849-9500-57a5c7402fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Flow 'volume_create_manager' (957545d6-3a4b-4589-9918-a7067ace5196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c2dec009-b31d-451a-8e7f-57b87e1b651f tempest-GroupSnapshotsTest-1416704093 None] Created volume successfully. Jul 08 01:29:05 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.912s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Deleted volume successfully. Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6237134d-1851-4424-a31a-79597f6110f3 tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "cinder-a8a2e1e2-d160-4eec-b772-5beb22fb0db5-delete_volume" released by "delete_volume" :: held 3.538s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Flow 'volume_create_manager' (de64695a-6139-4716-a2c0-0dec4df20b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e48ff9-8d2e-4ae0-b87b-01feea58e368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e48ff9-8d2e-4ae0-b87b-01feea58e368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-369621872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c859aa4d-2377-43e7-bff1-37728d43a5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d9bb4623be42838d0727f204ffb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:06Z,use_quota=True,user_id='ffe725a62fb14083af31f52301d374cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2595f047-c75f-411c-a9da-e8ba6ba23b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2595f047-c75f-411c-a9da-e8ba6ba23b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d98f30-6c05-43b9-9a18-4cfc2a39e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d98f30-6c05-43b9-9a18-4cfc2a39e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c859aa4d-2377-43e7-bff1-37728d43a5c0', 'volume_name': 'volume-c859aa4d-2377-43e7-bff1-37728d43a5c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12e7bc8-92bf-4b87-b32b-eaddfce4129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12e7bc8-92bf-4b87-b32b-eaddfce4129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d556be36-139e-48dc-bbe6-3ec3b05094ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Volume c859aa4d-2377-43e7-bff1-37728d43a5c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c859aa4d-2377-43e7-bff1-37728d43a5c0', 'volume_size': 1} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-369621872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c859aa4d-2377-43e7-bff1-37728d43a5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d9bb4623be42838d0727f204ffb135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:06Z,use_quota=True,user_id='ffe725a62fb14083af31f52301d374cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Creating volume c859aa4d-2377-43e7-bff1-37728d43a5c0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:06 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:06 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 1073741824 Jul 08 01:29:06 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Flow 'volume_create_manager' (ce55344f-7dfd-46f2-9617-d268885dfae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c7df75-5a23-46e0-bfb8-c9b099c69690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c7df75-5a23-46e0-bfb8-c9b099c69690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023767043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=091d732e-f78a-49a4-94a6-725cf9e57988,host='devstack@QuobyteHD#QuobyteHD',id=cf21867b-e92c-4174-aa63-b1520d6b3ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e39ea47cfc44acb8f99643c68eb4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:07Z,use_quota=True,user_id='6abba7b2dbf4427cb11e002d9ee1b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ae3dc9-7a33-4973-8098-502881552c18),volume_type_id=d4ae3dc9-7a33-4973-8098-502881552c18)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fc5c72-22a5-412e-a3c6-e2e3468eba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fc5c72-22a5-412e-a3c6-e2e3468eba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177556de-f8e0-4af7-bfab-80e6f3d2f40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177556de-f8e0-4af7-bfab-80e6f3d2f40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf21867b-e92c-4174-aa63-b1520d6b3ade', 'volume_name': 'volume-cf21867b-e92c-4174-aa63-b1520d6b3ade', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b95468-2ade-47fe-a629-c2d643a08dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b95468-2ade-47fe-a629-c2d643a08dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f500b915-184f-4108-b08f-a4ad2081f3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Volume cf21867b-e92c-4174-aa63-b1520d6b3ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf21867b-e92c-4174-aa63-b1520d6b3ade', 'volume_size': 1} Jul 08 01:29:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:07 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 1073741824" returned: 0 in 1.305s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:07 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 Jul 08 01:29:07 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:08 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0" returned: 0 in 0.748s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=091d732e-f78a-49a4-94a6-725cf9e57988,created_at=2026-07-07T23:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023767043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=091d732e-f78a-49a4-94a6-725cf9e57988,host='devstack@QuobyteHD#QuobyteHD',id=cf21867b-e92c-4174-aa63-b1520d6b3ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e39ea47cfc44acb8f99643c68eb4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:07Z,use_quota=True,user_id='6abba7b2dbf4427cb11e002d9ee1b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ae3dc9-7a33-4973-8098-502881552c18),volume_type_id=d4ae3dc9-7a33-4973-8098-502881552c18)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Creating volume cf21867b-e92c-4174-aa63-b1520d6b3ade {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d556be36-139e-48dc-bbe6-3ec3b05094ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c859aa4d-2377-43e7-bff1-37728d43a5c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:08 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade 1073741824 Jul 08 01:29:08 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd2f6e1-7923-4b1c-b5d6-7d62368a9c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Volume volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 (c859aa4d-2377-43e7-bff1-37728d43a5c0): created successfully Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd2f6e1-7923-4b1c-b5d6-7d62368a9c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Flow 'volume_create_manager' (de64695a-6139-4716-a2c0-0dec4df20b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-58b5ceee-bf7a-4e02-b989-529e76f387ad tempest-VolumeQuotasAdminTestJSON-375991351 None] Created volume successfully. Jul 08 01:29:09 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade 1073741824" returned: 0 in 1.295s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:09 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade Jul 08 01:29:09 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-c852d105-4102-4f67-b2a7-85786c60cec1 req-2e4a2ced-69c8-46e8-8aa0-aa517b7db1fc tempest-AttachVolumeShelveTestJSON-1279836056 None] No connector for attachment 75694816-be7b-44c0-b860-db65d1e73b67; skipping storage backend terminate_connection call. {{(pid=87204) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 01:29:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-c852d105-4102-4f67-b2a7-85786c60cec1 req-2e4a2ced-69c8-46e8-8aa0-aa517b7db1fc tempest-AttachVolumeShelveTestJSON-1279836056 None] Deleting attachment 75694816-be7b-44c0-b860-db65d1e73b67. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:29:10 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade" returned: 0 in 0.944s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.310s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f500b915-184f-4108-b08f-a4ad2081f3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf21867b-e92c-4174-aa63-b1520d6b3ade', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca4406b-783c-4805-91ad-68dc26ad3c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Volume volume-cf21867b-e92c-4174-aa63-b1520d6b3ade (cf21867b-e92c-4174-aa63-b1520d6b3ade): created successfully Jul 08 01:29:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca4406b-783c-4805-91ad-68dc26ad3c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Flow 'volume_create_manager' (ce55344f-7dfd-46f2-9617-d268885dfae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8fd3cdc8-a8f8-4913-b921-38bf87a9d643 tempest-VolumeQuotasAdminTestJSON-1928870413 None] Transfer volume completed successfully. Jul 08 01:29:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0c2af084-4c00-49df-9665-485936bbe017 tempest-GroupSnapshotsTest-1416704093 None] Created volume successfully. Jul 08 01:29:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f3035062-7319-463a-acdd-052b02bf16cf tempest-GroupSnapshotsTest-1416704093 None] Update group completed successfully. Jul 08 01:29:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Acquiring lock "cinder-c859aa4d-2377-43e7-bff1-37728d43a5c0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Lock "cinder-c859aa4d-2377-43e7-bff1-37728d43a5c0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Acquiring lock "cinder-quobyte-c859aa4d-2377-43e7-bff1-37728d43a5c0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Lock "cinder-quobyte-c859aa4d-2377-43e7-bff1-37728d43a5c0" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9706f40-6884-4241-8551-df8f062300cf]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:11 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 Jul 08 01:29:11 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e5057bfe-5f59-4fea-bc07-69140eb08541 tempest-GroupSnapshotsTest-1416704093 None] Update group completed successfully. Jul 08 01:29:12 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0" returned: 0 in 1.241s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:12 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0 Jul 08 01:29:12 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e0a96068-8f88-47b5-b1d9-a4aa33188ebb tempest-GroupSnapshotsTest-1416704093 None] Update group completed successfully. Jul 08 01:29:13 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c859aa4d-2377-43e7-bff1-37728d43a5c0" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Lock "cinder-quobyte-c859aa4d-2377-43e7-bff1-37728d43a5c0" released by "delete_volume" :: held 2.064s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Created reservations ['83a07274-7193-4e98-b296-87b4d9628b77', 'abc1f2dd-ae80-429f-ad12-c0c0df391df7', '823fa7d2-7db5-49ac-b7fb-b28e8ed2cda4', 'de7c139c-1acd-4774-acc1-90893cd4a1c7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:13 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:29:13 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bc8de79a-81ce-47d7-81d1-59917e54fa0b tempest-GroupSnapshotsTest-1416704093 None] Update group completed successfully. Jul 08 01:29:14 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.936s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:14 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Deleted volume successfully. Jul 08 01:29:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-77ec4f46-ccd9-4828-90d2-e3f1a39b14e8 tempest-VolumeQuotasAdminTestJSON-1932744331 None] Lock "cinder-c859aa4d-2377-43e7-bff1-37728d43a5c0-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] GroupSnapshot 1bd37dbf-48cf-4ba0-8f07-d3b042d784d8: creating. Jul 08 01:29:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Group snapshot 1bd37dbf-48cf-4ba0-8f07-d3b042d784d8: creating. {{(pid=87204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:29:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Creating offline snapshot 145c8a43-20a3-4782-b099-092eda07e8cd of volume 20c93464-875a-47d6-9533-f45a944558f0 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[785d3d77-875d-4ed7-b1e3-3fe5b8d1d480]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:16 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 Jul 08 01:29:16 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:17 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0" returned: 0 in 1.071s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:17 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd 1G Jul 08 01:29:17 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Flow 'volume_create_manager' (3bb49a93-cbdf-44d0-818a-cfe20170e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adafc940-45f5-481b-82f7-a4c8ec84483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adafc940-45f5-481b-82f7-a4c8ec84483e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-95078620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85313076-0d03-46a8-a9bb-3fe2049fcdbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9061d29e51c74a8eacc601e5ff5af0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:18Z,use_quota=True,user_id='905b68c197d449d185321b99a359230c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8d4af9-59ed-49a7-955c-bc86165c7fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8d4af9-59ed-49a7-955c-bc86165c7fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebadf63-1d8f-4250-91c5-027cc0347652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebadf63-1d8f-4250-91c5-027cc0347652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85313076-0d03-46a8-a9bb-3fe2049fcdbb', 'volume_name': 'volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b990f56-5116-4a13-ad3b-7817e4f4073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b990f56-5116-4a13-ad3b-7817e4f4073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1ff4fd-d8d2-48f3-9c23-8405d5fdbf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Volume 85313076-0d03-46a8-a9bb-3fe2049fcdbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb', 'volume_size': 1} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Flow 'volume_create_manager' (2fa2d291-b093-430d-a4db-4a8f8af40682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337fed54-97f1-4351-8ef7-8b8ccbba6352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337fed54-97f1-4351-8ef7-8b8ccbba6352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1849615058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c90d190-6c2b-4edf-8506-c6800f7acea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9061d29e51c74a8eacc601e5ff5af0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:18Z,use_quota=True,user_id='905b68c197d449d185321b99a359230c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec2ef5f-0d8c-4e9e-b3cc-fa11a8f16e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec2ef5f-0d8c-4e9e-b3cc-fa11a8f16e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0deccf65-3d3c-43a5-87cb-78f736d7203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0deccf65-3d3c-43a5-87cb-78f736d7203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c90d190-6c2b-4edf-8506-c6800f7acea0', 'volume_name': 'volume-0c90d190-6c2b-4edf-8506-c6800f7acea0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62185693-e69c-4106-8673-1f861dde9960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62185693-e69c-4106-8673-1f861dde9960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf23aa5-7aa3-41dd-9a4c-072648447f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Volume 0c90d190-6c2b-4edf-8506-c6800f7acea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c90d190-6c2b-4edf-8506-c6800f7acea0', 'volume_size': 1} Jul 08 01:29:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:19 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd 1G" returned: 0 in 1.266s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c93464-875a-47d6-9533-f45a944558f0 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:19 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c93464-875a-47d6-9533-f45a944558f0 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd Jul 08 01:29:19 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:19 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c93464-875a-47d6-9533-f45a944558f0 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd" returned: 0 in 0.882s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:19 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:29:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:20 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd Jul 08 01:29:20 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:20 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd" returned: 0 in 0.835s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:20 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.info Jul 08 01:29:20 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:21 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.info" returned: 0 in 0.780s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:21 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:29:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:21 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.info Jul 08 01:29:21 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:22 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.info" returned: 0 in 0.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.816s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Creating offline snapshot 2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 of volume cf21867b-e92c-4174-aa63-b1520d6b3ade {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd20b277-fa1a-4139-98bc-af8c2cb9649c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:22 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade Jul 08 01:29:22 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:24 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade" returned: 0 in 1.543s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:24 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 1G Jul 08 01:29:24 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:25 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 1G" returned: 0 in 1.190s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf21867b-e92c-4174-aa63-b1520d6b3ade -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:25 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf21867b-e92c-4174-aa63-b1520d6b3ade -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 Jul 08 01:29:25 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:26 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf21867b-e92c-4174-aa63-b1520d6b3ade -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7" returned: 0 in 1.014s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:26 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:26 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 Jul 08 01:29:26 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Flow 'volume_create_manager' (0bc680cb-57d7-4a0c-8609-cece89b7d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7c5c4f-0aee-4ebf-9125-aba524ca8822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7c5c4f-0aee-4ebf-9125-aba524ca8822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1164542237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006a73f1-b5b7-4e39-b19b-56140eccc10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f0b7fdc435475e985d789653af285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:26Z,use_quota=True,user_id='ff5c1601c0fe4a378b0cdde8be8a8ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea42356-3c7e-42f5-9a66-d5d92b7b678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea42356-3c7e-42f5-9a66-d5d92b7b678f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49097dc4-7329-48e4-ba88-35b4416b57cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49097dc4-7329-48e4-ba88-35b4416b57cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006a73f1-b5b7-4e39-b19b-56140eccc10f', 'volume_name': 'volume-006a73f1-b5b7-4e39-b19b-56140eccc10f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be68435-6472-415a-b0d7-81b9db1a52d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be68435-6472-415a-b0d7-81b9db1a52d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f190dd-0fb3-4e83-b5ea-2f1379f36411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Volume 006a73f1-b5b7-4e39-b19b-56140eccc10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006a73f1-b5b7-4e39-b19b-56140eccc10f', 'volume_size': 1} Jul 08 01:29:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:27 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7" returned: 0 in 0.701s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:27 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.info Jul 08 01:29:27 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:27 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.info" returned: 0 in 0.720s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:27 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:27 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.info Jul 08 01:29:27 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:28 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.info" returned: 0 in 0.819s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.102s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.959s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1849615058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c90d190-6c2b-4edf-8506-c6800f7acea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9061d29e51c74a8eacc601e5ff5af0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:18Z,use_quota=True,user_id='905b68c197d449d185321b99a359230c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Creating volume 0c90d190-6c2b-4edf-8506-c6800f7acea0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:28 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:29:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:28 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 1073741824 Jul 08 01:29:28 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b538a5f7-d8f3-4d1a-b8a1-2cdf538e0573 tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 1bd37dbf-48cf-4ba0-8f07-d3b042d784d8: created successfully Jul 08 01:29:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 1bd37dbf-48cf-4ba0-8f07-d3b042d784d8: deleting Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 1bd37dbf-48cf-4ba0-8f07-d3b042d784d8: deleting {{(pid=87204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-20c93464-875a-47d6-9533-f45a944558f0" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-20c93464-875a-47d6-9533-f45a944558f0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-145c8a43-20a3-4782-b099-092eda07e8cd" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-145c8a43-20a3-4782-b099-092eda07e8cd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Deleting offline snapshot 145c8a43-20a3-4782-b099-092eda07e8cd of volume 20c93464-875a-47d6-9533-f45a944558f0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] snapshot_file for this snap is: volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9002ca-19c2-4418-ae60-2b99a8deb2e9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:29 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 1073741824" returned: 0 in 1.189s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:29 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 Jul 08 01:29:29 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:29 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd Jul 08 01:29:29 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:31 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0" returned: 0 in 1.230s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] <== create_volume: return (2471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.860s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-95078620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85313076-0d03-46a8-a9bb-3fe2049fcdbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9061d29e51c74a8eacc601e5ff5af0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:18Z,use_quota=True,user_id='905b68c197d449d185321b99a359230c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Creating volume 85313076-0d03-46a8-a9bb-3fe2049fcdbb {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:31 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf23aa5-7aa3-41dd-9a4c-072648447f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c90d190-6c2b-4edf-8506-c6800f7acea0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42726cac-a995-4e2e-ae23-ba35256b0cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Volume volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 (0c90d190-6c2b-4edf-8506-c6800f7acea0): created successfully Jul 08 01:29:31 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb 1073741824 Jul 08 01:29:31 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42726cac-a995-4e2e-ae23-ba35256b0cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Flow 'volume_create_manager' (2fa2d291-b093-430d-a4db-4a8f8af40682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e79fc1fd-6b35-4236-9dd2-eb494630d142 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Created volume successfully. Jul 08 01:29:31 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd" returned: 0 in 1.526s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20c93464-875a-47d6-9533-f45a944558f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6977c0-8cee-4587-95e1-e37a35ddcdfb]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:31 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 Jul 08 01:29:31 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:32 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb 1073741824" returned: 0 in 1.334s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:32 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0" returned: 0 in 1.118s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:32 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd Jul 08 01:29:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:32 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:32 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb Jul 08 01:29:32 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:33 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb" returned: 0 in 0.720s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.721s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1164542237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006a73f1-b5b7-4e39-b19b-56140eccc10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f0b7fdc435475e985d789653af285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:26Z,use_quota=True,user_id='ff5c1601c0fe4a378b0cdde8be8a8ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Creating volume 006a73f1-b5b7-4e39-b19b-56140eccc10f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:33 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:33 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f 1073741824 Jul 08 01:29:33 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1ff4fd-d8d2-48f3-9c23-8405d5fdbf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b441af6-8893-4730-a0ba-0a9339d9a178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:33 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Volume volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb (85313076-0d03-46a8-a9bb-3fe2049fcdbb): created successfully Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b441af6-8893-4730-a0ba-0a9339d9a178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Flow 'volume_create_manager' (3bb49a93-cbdf-44d0-818a-cfe20170e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bb3b63a8-3259-4f29-ba73-a34a20dcfb65 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Created volume successfully. Jul 08 01:29:33 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd" returned: 0 in 1.079s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:33 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd Jul 08 01:29:33 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:34 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f 1073741824" returned: 0 in 1.346s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:34 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0.145c8a43-20a3-4782-b099-092eda07e8cd" returned: 0 in 1.089s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-145c8a43-20a3-4782-b099-092eda07e8cd" released by "_delete_snapshot" :: held 4.963s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-20c93464-875a-47d6-9533-f45a944558f0" released by "delete_snapshot" :: held 5.002s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-cf21867b-e92c-4174-aa63-b1520d6b3ade" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-cf21867b-e92c-4174-aa63-b1520d6b3ade" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-2a57a6a2-d6b8-4226-9dce-09cbff09b8b7" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:34 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f Jul 08 01:29:34 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-2a57a6a2-d6b8-4226-9dce-09cbff09b8b7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Deleting offline snapshot 2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 of volume cf21867b-e92c-4174-aa63-b1520d6b3ade {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] snapshot_file for this snap is: volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e3473b-8f0b-4e6f-90c6-3f708598097d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:34 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 Jul 08 01:29:34 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:36 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f" returned: 0 in 1.346s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.831s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f190dd-0fb3-4e83-b5ea-2f1379f36411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006a73f1-b5b7-4e39-b19b-56140eccc10f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08db97f2-8d60-4478-b634-de1c096df015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:36 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Volume volume-006a73f1-b5b7-4e39-b19b-56140eccc10f (006a73f1-b5b7-4e39-b19b-56140eccc10f): created successfully Jul 08 01:29:36 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08db97f2-8d60-4478-b634-de1c096df015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Flow 'volume_create_manager' (0bc680cb-57d7-4a0c-8609-cece89b7d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7" returned: 0 in 1.481s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf21867b-e92c-4174-aa63-b1520d6b3ade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:29:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f07eff31-d45a-4220-9f7a-9c4e5a451ddd tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Created volume successfully. Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcefade-15b7-4a9e-91c1-b925e3896ef7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:36 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade Jul 08 01:29:36 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:37 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade" returned: 0 in 1.286s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:37 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 Jul 08 01:29:37 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:38 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7" returned: 0 in 1.030s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:38 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7 Jul 08 01:29:38 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Acquiring lock "cinder-006a73f1-b5b7-4e39-b19b-56140eccc10f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "cinder-006a73f1-b5b7-4e39-b19b-56140eccc10f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Acquiring lock "cinder-quobyte-006a73f1-b5b7-4e39-b19b-56140eccc10f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "cinder-quobyte-006a73f1-b5b7-4e39-b19b-56140eccc10f" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5f7951-3e3b-4134-9c56-80efc29d4be4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:39 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f Jul 08 01:29:39 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:39 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade.2a57a6a2-d6b8-4226-9dce-09cbff09b8b7" returned: 0 in 1.062s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-2a57a6a2-d6b8-4226-9dce-09cbff09b8b7" released by "_delete_snapshot" :: held 5.004s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-cf21867b-e92c-4174-aa63-b1520d6b3ade" released by "delete_snapshot" :: held 5.034s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:39 devstack cinder-volume[87204]: WARNING cinder.quota [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1282353675 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1282353675, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:29:39 devstack cinder-volume[87204]: WARNING cinder.quota [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1282353675 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1282353675, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:29:39 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['773ea091-ea75-4f67-863d-ad5db0fc0cbb', '5fc16d89-dcce-4ded-a6a1-6b37b9a26cd9', 'a407520c-3e25-4871-9584-fec3a804c207', '9a988dc4-77b8-4b7b-a287-b3f53b4b2a53'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:40 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['378ab961-2b4c-4ab0-9ff7-3cff0e55096f', '62ec0dc3-0371-429c-91c9-c6c9992f82ea', '93eb07e3-8d0d-4b14-891d-f574a03f5b40', 'e1168ef6-7c22-4dc6-bbe3-461ceb3372ae'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2d45c8c0-b081-492b-8b37-625dbcb39036 tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 1bd37dbf-48cf-4ba0-8f07-d3b042d784d8: deleted successfully Jul 08 01:29:40 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f" returned: 0 in 1.438s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:40 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f Jul 08 01:29:40 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-20c93464-875a-47d6-9533-f45a944558f0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-20c93464-875a-47d6-9533-f45a944558f0" acquired by "delete_volume" :: waited 0.045s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b2d101-5284-4904-95fd-7a8739f8a1c5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:41 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-006a73f1-b5b7-4e39-b19b-56140eccc10f" returned: 0 in 1.166s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "cinder-quobyte-006a73f1-b5b7-4e39-b19b-56140eccc10f" released by "delete_volume" :: held 2.679s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:41 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 Jul 08 01:29:41 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:41 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Created reservations ['c0bc360b-0764-4c7f-aef3-86cdc678de02', 'd8160688-455e-4be2-81b4-c4798e383f59', 'cb6f6311-2596-48e8-9d2b-0009fa07bbb7', '6bdac6a0-74e2-462e-958c-d4d148d455e8'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:42 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:29:42 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:43 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.117s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:43 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Deleted volume successfully. Jul 08 01:29:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e128d35a-eae9-43cc-b42a-ea6e1dc7a8a6 tempest-VolumeQuotasNegativeTestJSON-1718432007 None] Lock "cinder-006a73f1-b5b7-4e39-b19b-56140eccc10f-delete_volume" released by "delete_volume" :: held 4.282s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:43 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0" returned: 0 in 2.027s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:43 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0 Jul 08 01:29:43 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:45 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-20c93464-875a-47d6-9533-f45a944558f0" returned: 0 in 1.384s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-20c93464-875a-47d6-9533-f45a944558f0" released by "delete_volume" :: held 3.568s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-cf21867b-e92c-4174-aa63-b1520d6b3ade" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-cf21867b-e92c-4174-aa63-b1520d6b3ade" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd85f0dc-d50f-4551-b6e9-5c46025625b5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:45 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade Jul 08 01:29:45 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:46 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade" returned: 0 in 1.329s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:46 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade Jul 08 01:29:46 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:47 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cf21867b-e92c-4174-aa63-b1520d6b3ade" returned: 0 in 1.058s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-cf21867b-e92c-4174-aa63-b1520d6b3ade" released by "delete_volume" :: held 2.500s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:47 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=95,cinder:UPDATE=99,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:29:47 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=112,cinder:SELECT=89,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:29:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['d541705b-180d-449f-97e6-cb97d8d93c03'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:47 devstack cinder-volume[87204]: WARNING cinder.quota [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1282353675 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1282353675, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:29:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['b9247264-0ee8-42d3-a98f-0df216b35a99', 'deeeca22-c17c-445f-9058-c9aa6d00a9e8', '7861abf4-ff32-4d1e-b73a-9f6c1fb2f067', '5e984bdb-49b2-4ebf-82db-b056a8659b77'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['5fca9835-69e6-4d97-a976-979907bf7d37', 'e65f08a0-5f67-474a-aeb2-500ed68f133e', '63bd254c-7e5e-4d0c-9d0d-fdd9fb859db5', '8b03d6e9-a1bf-4ca6-ab11-2940f12fb121'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:48 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:29:48 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-330757a2-539f-4c7c-98e7-afd65779a64b tempest-GroupSnapshotsTest-1416704093 None] Group tempest-GroupSnapshotsTest-Group-1852618436: creating Jul 08 01:29:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-330757a2-539f-4c7c-98e7-afd65779a64b tempest-GroupSnapshotsTest-1416704093 None] Group tempest-GroupSnapshotsTest-Group-1852618436: created successfully Jul 08 01:29:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-330757a2-539f-4c7c-98e7-afd65779a64b tempest-GroupSnapshotsTest-1416704093 None] Create group completed successfully. Jul 08 01:29:49 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.983s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9a578c5c-4067-4cf1-863e-f584b2648ced tempest-GroupSnapshotsTest-1416704093 None] Delete group completed successfully. Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Flow 'volume_create_manager' (35dc9c26-9f9c-4912-88c4-7b035fbe7579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e74c17b-eee4-4317-b4b7-1698a5379a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e74c17b-eee4-4317-b4b7-1698a5379a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-868877912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13eab087-3807-4b13-bd5f-0395c6877edb,host='devstack@QuobyteHD#QuobyteHD',id=cc6a7df7-ecba-45cd-8737-8ae398644874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e39ea47cfc44acb8f99643c68eb4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:51Z,use_quota=True,user_id='6abba7b2dbf4427cb11e002d9ee1b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc04a49e-6f34-41c6-8048-7ea8854249fa),volume_type_id=fc04a49e-6f34-41c6-8048-7ea8854249fa)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217e732e-7d17-461a-a645-dcd6ef0308f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217e732e-7d17-461a-a645-dcd6ef0308f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ff85d3-6871-43d8-9828-8ea98f42ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ff85d3-6871-43d8-9828-8ea98f42ce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6a7df7-ecba-45cd-8737-8ae398644874', 'volume_name': 'volume-cc6a7df7-ecba-45cd-8737-8ae398644874', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e93c94-5790-431a-94eb-df8fbb5d54b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e93c94-5790-431a-94eb-df8fbb5d54b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5915a0-a527-481d-9a0b-32bf43743662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Volume cc6a7df7-ecba-45cd-8737-8ae398644874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6a7df7-ecba-45cd-8737-8ae398644874', 'volume_size': 1} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13eab087-3807-4b13-bd5f-0395c6877edb,created_at=2026-07-07T23:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-868877912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13eab087-3807-4b13-bd5f-0395c6877edb,host='devstack@QuobyteHD#QuobyteHD',id=cc6a7df7-ecba-45cd-8737-8ae398644874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e39ea47cfc44acb8f99643c68eb4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:51Z,use_quota=True,user_id='6abba7b2dbf4427cb11e002d9ee1b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc04a49e-6f34-41c6-8048-7ea8854249fa),volume_type_id=fc04a49e-6f34-41c6-8048-7ea8854249fa)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Creating volume cc6a7df7-ecba-45cd-8737-8ae398644874 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:29:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:51 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 1073741824 Jul 08 01:29:51 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:52 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 1073741824" returned: 0 in 1.159s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:52 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 Jul 08 01:29:52 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:53 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874" returned: 0 in 0.950s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] <== create_volume: return (2202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5915a0-a527-481d-9a0b-32bf43743662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6a7df7-ecba-45cd-8737-8ae398644874', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0a4072-a856-4440-847b-99eda785a103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Volume volume-cc6a7df7-ecba-45cd-8737-8ae398644874 (cc6a7df7-ecba-45cd-8737-8ae398644874): created successfully Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0a4072-a856-4440-847b-99eda785a103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Flow 'volume_create_manager' (35dc9c26-9f9c-4912-88c4-7b035fbe7579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-71e1b78d-0419-4603-b28a-9357dd13c86e tempest-GroupSnapshotsTest-1416704093 None] Created volume successfully. Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:53 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:29:53 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:54 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.805s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:29:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:29:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:29:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] GroupSnapshot 51b15e94-24a2-41be-87aa-3392ba7275c2: creating. Jul 08 01:29:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Group snapshot 51b15e94-24a2-41be-87aa-3392ba7275c2: creating. {{(pid=87204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:29:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Creating offline snapshot 7bc55212-c708-4ddd-b453-9a3aaed4086e of volume cc6a7df7-ecba-45cd-8737-8ae398644874 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f4acdc-7948-4bdb-885a-47549dc5a1a1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:55 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 Jul 08 01:29:55 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:56 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874" returned: 0 in 0.986s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:56 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e 1G Jul 08 01:29:56 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:57 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e 1G" returned: 0 in 0.951s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6a7df7-ecba-45cd-8737-8ae398644874 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:57 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6a7df7-ecba-45cd-8737-8ae398644874 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e Jul 08 01:29:57 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:58 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6a7df7-ecba-45cd-8737-8ae398644874 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e" returned: 0 in 1.007s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:58 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:58 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e Jul 08 01:29:58 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Flow 'volume_create_manager' (1e348adc-0b4a-4095-b24c-d2e93eff1406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6e4c80-3c3f-4d3c-a3b2-34198d9b9ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6e4c80-3c3f-4d3c-a3b2-34198d9b9ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1254345226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a3ed58-1c8d-4013-9d0c-9ff4c69a1379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6e65ab7399484c8bfa5daa88efb95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:58Z,use_quota=True,user_id='bd1c6511e47e47d2a9238cd8ede376ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aa2d37-786d-46bf-9911-92268a2bb2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aa2d37-786d-46bf-9911-92268a2bb2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8b9e3d-cda9-49d7-88f4-681d943974f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8b9e3d-cda9-49d7-88f4-681d943974f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a3ed58-1c8d-4013-9d0c-9ff4c69a1379', 'volume_name': 'volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ec2c7c-9a66-42f1-9260-91aa660f8afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ec2c7c-9a66-42f1-9260-91aa660f8afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d51518c-b600-4dec-99d6-3016cc32d1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Volume 37a3ed58-1c8d-4013-9d0c-9ff4c69a1379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379', 'volume_size': 1} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:58 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e" returned: 0 in 0.812s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:58 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.info Jul 08 01:29:58 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:59 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.info" returned: 0 in 0.833s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:59 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:29:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:59 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.info Jul 08 01:29:59 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:00 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.info" returned: 0 in 0.762s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.446s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1254345226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a3ed58-1c8d-4013-9d0c-9ff4c69a1379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6e65ab7399484c8bfa5daa88efb95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:58Z,use_quota=True,user_id='bd1c6511e47e47d2a9238cd8ede376ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Creating volume 37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:00 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:30:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:00 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 1073741824 Jul 08 01:30:00 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3c1274b4-cb82-4975-88c2-41de9d048a63 tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 51b15e94-24a2-41be-87aa-3392ba7275c2: created successfully Jul 08 01:30:01 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 1073741824" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:01 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 Jul 08 01:30:01 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 51b15e94-24a2-41be-87aa-3392ba7275c2: deleting Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 51b15e94-24a2-41be-87aa-3392ba7275c2: deleting {{(pid=87204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-cc6a7df7-ecba-45cd-8737-8ae398644874" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-cc6a7df7-ecba-45cd-8737-8ae398644874" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-7bc55212-c708-4ddd-b453-9a3aaed4086e" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-7bc55212-c708-4ddd-b453-9a3aaed4086e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Deleting offline snapshot 7bc55212-c708-4ddd-b453-9a3aaed4086e of volume cc6a7df7-ecba-45cd-8737-8ae398644874 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] snapshot_file for this snap is: volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2691056-e038-4930-b244-4de7f7dc55b0]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:02 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e Jul 08 01:30:02 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:02 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" returned: 0 in 0.728s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d51518c-b600-4dec-99d6-3016cc32d1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc74fa01-a476-4648-9406-25953f20cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Volume volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 (37a3ed58-1c8d-4013-9d0c-9ff4c69a1379): created successfully Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc74fa01-a476-4648-9406-25953f20cb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Flow 'volume_create_manager' (1e348adc-0b4a-4095-b24c-d2e93eff1406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-273d7c12-9a80-4d59-b436-1597bc7147bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Created volume successfully. Jul 08 01:30:02 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e" returned: 0 in 0.859s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc6a7df7-ecba-45cd-8737-8ae398644874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd20b9-0157-4b48-bafd-bb91e25946fe]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:02 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 Jul 08 01:30:02 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Creating offline snapshot 11ba8911-5e0a-42e0-bb66-adbf05c48a6a of volume 37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:30:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa25a0c6-8905-4df7-a026-b0a00d553b8b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:03 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 Jul 08 01:30:03 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:03 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874" returned: 0 in 0.928s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:03 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e Jul 08 01:30:03 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:04 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" returned: 0 in 0.896s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:04 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a 1G Jul 08 01:30:04 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:04 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e" returned: 0 in 0.960s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:04 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e Jul 08 01:30:04 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Acquiring lock "cinder-777b694c-963f-48f4-bdc6-d865600a39e6-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "cinder-777b694c-963f-48f4-bdc6-d865600a39e6-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Acquiring lock "cinder-quobyte-777b694c-963f-48f4-bdc6-d865600a39e6" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:05 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a 1G" returned: 0 in 1.363s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "cinder-quobyte-777b694c-963f-48f4-bdc6-d865600a39e6" acquired by "delete_volume" :: waited 0.049s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:05 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a Jul 08 01:30:05 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e54f6ac-6969-42cb-be8c-5208b792c6f9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:05 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6 Jul 08 01:30:05 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:05 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874.7bc55212-c708-4ddd-b453-9a3aaed4086e" returned: 0 in 1.135s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-7bc55212-c708-4ddd-b453-9a3aaed4086e" released by "_delete_snapshot" :: held 4.020s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-cc6a7df7-ecba-45cd-8737-8ae398644874" released by "delete_snapshot" :: held 4.047s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:05 devstack cinder-volume[87204]: WARNING cinder.quota [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-72301626 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-72301626, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:30:05 devstack cinder-volume[87204]: WARNING cinder.quota [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-72301626 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-72301626, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:30:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['7a311f0e-c7cc-4b31-ba4b-d7f03e086206', 'bdbeddf9-94a1-4642-b486-1f6818c4183b', '0eb512a8-d85b-482f-bba3-b7e3a61267b7', '0dfff4da-a364-45c8-90cd-4f6bbcbbdb42'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e28f0627-71e7-46be-89a0-3ac459c18386 tempest-GroupSnapshotsTest-1416704093 None] group_snapshot 51b15e94-24a2-41be-87aa-3392ba7275c2: deleted successfully Jul 08 01:30:06 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:06 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a is being set with open permissions: ugo+rw Jul 08 01:30:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:06 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a Jul 08 01:30:06 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:06 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6" returned: 0 in 0.996s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "cinder-quobyte-cc6a7df7-ecba-45cd-8737-8ae398644874" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:06 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6 Jul 08 01:30:06 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-cc6a7df7-ecba-45cd-8737-8ae398644874" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa34353-e1c0-47b7-92fe-5470b43f1bbe]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:06 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 Jul 08 01:30:06 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:07 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a" returned: 0 in 0.774s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:07 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.info Jul 08 01:30:07 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:07 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-777b694c-963f-48f4-bdc6-d865600a39e6" returned: 0 in 0.870s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "cinder-quobyte-777b694c-963f-48f4-bdc6-d865600a39e6" released by "delete_volume" :: held 1.939s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Created reservations ['4312e60a-1dd4-431e-8058-7d248f76bb69', 'c7d368c4-da2d-4884-9f3a-33dbad198d4a', '213f7e7f-92db-445d-b8dd-4ee0424d1d6d', '5cc7d126-8262-4b69-898b-5b27af85f181'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:07 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874" returned: 0 in 0.875s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:07 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874 Jul 08 01:30:07 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:07 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:30:07 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:08 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.info" returned: 0 in 0.890s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:08 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.info is being set with open permissions: ugo+rw Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:08 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.info Jul 08 01:30:08 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:08 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc6a7df7-ecba-45cd-8737-8ae398644874" returned: 0 in 0.934s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Lock "cinder-quobyte-cc6a7df7-ecba-45cd-8737-8ae398644874" released by "delete_volume" :: held 1.901s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:08 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.991s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Deleted volume successfully. Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['a2f3de0d-47a6-4f20-8680-5e57b44369ca'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a68ae7d8-e295-4a4c-a4c7-2e19348a5a81 tempest-AttachVolumeShelveTestJSON-1279836056 None] Lock "cinder-777b694c-963f-48f4-bdc6-d865600a39e6-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:08 devstack cinder-volume[87204]: WARNING cinder.quota [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-72301626 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-72301626, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Created reservations ['d720e243-1125-4289-a154-2fc47869600e', '4a5f3499-7a38-4cc0-a1ea-4482478397ae', '563ad6aa-6f06-4591-a615-898227201298', 'cbadd7b2-796d-4def-acc2-a4664841a8ed'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:08 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:30:08 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d0b4a8e0-a50f-463d-b7c6-b55587b2c123 req-4906ae31-ebb6-4867-abb2-77da4e5f2a6e tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:09 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.info" returned: 0 in 1.051s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.977s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d0b4a8e0-a50f-463d-b7c6-b55587b2c123 req-4906ae31-ebb6-4867-abb2-77da4e5f2a6e tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.230s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a15ae7f-a827-4d37-bf9c-af31ca8150a7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d0b4a8e0-a50f-463d-b7c6-b55587b2c123 req-4906ae31-ebb6-4867-abb2-77da4e5f2a6e tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a1aecaf7-2ac6-4442-986f-e6583ec55370 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Create snapshot completed successfully Jul 08 01:30:09 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb Jul 08 01:30:09 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:09 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.881s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a963db8-72c0-4df8-a7fe-b4f5d027ade4 tempest-GroupSnapshotsTest-1416704093 None] Delete group completed successfully. Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Acquiring lock "cinder-11ba8911-5e0a-42e0-bb66-adbf05c48a6a-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-11ba8911-5e0a-42e0-bb66-adbf05c48a6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Acquiring lock "cinder-quobyte-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-quobyte-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Acquiring lock "cinder-quobyte-11ba8911-5e0a-42e0-bb66-adbf05c48a6a" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-quobyte-11ba8911-5e0a-42e0-bb66-adbf05c48a6a" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Deleting offline snapshot 11ba8911-5e0a-42e0-bb66-adbf05c48a6a of volume 37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] snapshot_file for this snap is: volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd6f21-a5ac-42c6-a4df-282c77737494]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:10 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d0b4a8e0-a50f-463d-b7c6-b55587b2c123 req-4906ae31-ebb6-4867-abb2-77da4e5f2a6e tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb" returned: 0 in 1.194s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d0b4a8e0-a50f-463d-b7c6-b55587b2c123 req-4906ae31-ebb6-4867-abb2-77da4e5f2a6e tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.221s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-d0b4a8e0-a50f-463d-b7c6-b55587b2c123 req-4906ae31-ebb6-4867-abb2-77da4e5f2a6e tempest-TestServerVolumeAttachmentScenario-1397312203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cae1a11d-f001-4a70-b4bb-3b00738bdedf', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:30:10 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a Jul 08 01:30:10 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-d0b4a8e0-a50f-463d-b7c6-b55587b2c123 req-4906ae31-ebb6-4867-abb2-77da4e5f2a6e tempest-TestServerVolumeAttachmentScenario-1397312203 None] attachment_update completed successfully. Jul 08 01:30:11 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a" returned: 0 in 1.105s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:30:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f268fc0e-bdf9-41a4-a438-7e8da56bedcd]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:11 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 Jul 08 01:30:11 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:12 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" returned: 0 in 1.240s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:12 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a Jul 08 01:30:12 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:13 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a" returned: 0 in 0.930s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:13 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a Jul 08 01:30:13 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:14 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379.11ba8911-5e0a-42e0-bb66-adbf05c48a6a" returned: 0 in 0.829s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-quobyte-11ba8911-5e0a-42e0-bb66-adbf05c48a6a" released by "_delete_snapshot" :: held 4.258s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-quobyte-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" released by "delete_snapshot" :: held 4.312s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:14 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Created reservations ['4e277fc1-8011-4f1a-8540-a25565683c31', 'abc88016-5f71-4b21-90ae-8dd2f6806913', '7563fc9c-09d5-4fca-95a7-aad17a0099bb', '9f705e5b-72b5-433a-acab-da4b82b407b6'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Delete snapshot completed successfully. Jul 08 01:30:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf6edc32-02b6-43da-abb2-d72c113283d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-11ba8911-5e0a-42e0-bb66-adbf05c48a6a-delete_snapshot" released by "delete_snapshot" :: held 4.521s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Acquiring lock "cinder-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Acquiring lock "cinder-quobyte-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-quobyte-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f1c37d-7724-4a54-b86f-1735a33c6369]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:15 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 Jul 08 01:30:15 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:16 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" returned: 0 in 1.012s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:16 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379 Jul 08 01:30:16 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6d67f908-ecba-4fab-bb57-489f011f7c24 tempest-GroupsV314Test-632247292 None] Group tempest-GroupsV314Test-Group-340915059: creating Jul 08 01:30:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6d67f908-ecba-4fab-bb57-489f011f7c24 tempest-GroupsV314Test-632247292 None] Group tempest-GroupsV314Test-Group-340915059: created successfully Jul 08 01:30:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6d67f908-ecba-4fab-bb57-489f011f7c24 tempest-GroupsV314Test-632247292 None] Create group completed successfully. Jul 08 01:30:17 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" returned: 0 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-quobyte-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379" released by "delete_volume" :: held 1.901s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:18 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Created reservations ['2cfbd26d-42e5-41dc-98ed-893936066752', 'd6c821c8-d234-4d6e-a03c-38777c7076cf', '9e1089a3-2b28-4346-8be6-f8a5614731c6', '2be18bdd-ec27-4d5e-a117-1ca25dd0ce0c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:19 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:30:19 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:19 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.653s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:19 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Deleted volume successfully. Jul 08 01:30:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4eedbb41-a617-4ef3-a16c-a544e61b48a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1941368051 None] Lock "cinder-37a3ed58-1c8d-4013-9d0c-9ff4c69a1379-delete_volume" released by "delete_volume" :: held 5.001s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Flow 'volume_create_manager' (c99817c1-ef9d-44ab-8d6b-a92b3e8d10f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f26884-e86f-4f57-9e5a-74eb2d45674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f26884-e86f-4f57-9e5a-74eb2d45674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1590871393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27cb1fb-7491-4311-90fd-d6553535628b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a467070f48c4d849b317827167d2d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:24Z,use_quota=True,user_id='83dc55d9a5fc4e19b4073298f367e751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6429a1ea-ced2-4f43-9f0b-bf30e315d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6429a1ea-ced2-4f43-9f0b-bf30e315d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c4db4c-4acd-4e29-a20a-126a293fccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c4db4c-4acd-4e29-a20a-126a293fccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27cb1fb-7491-4311-90fd-d6553535628b', 'volume_name': 'volume-b27cb1fb-7491-4311-90fd-d6553535628b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ba3c54-fa78-423a-bf95-f58a7d0eaa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ba3c54-fa78-423a-bf95-f58a7d0eaa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f171691-2dd3-43bd-850f-c19c476bd256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Volume b27cb1fb-7491-4311-90fd-d6553535628b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27cb1fb-7491-4311-90fd-d6553535628b', 'volume_size': 1} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1590871393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27cb1fb-7491-4311-90fd-d6553535628b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a467070f48c4d849b317827167d2d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:24Z,use_quota=True,user_id='83dc55d9a5fc4e19b4073298f367e751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Creating volume b27cb1fb-7491-4311-90fd-d6553535628b {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:24 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:24 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b 1073741824 Jul 08 01:30:24 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Flow 'volume_create_manager' (4ce44cc4-1588-42f1-8d27-ee7b2ccde2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b491db72-5997-4337-8009-8092e6c90318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b491db72-5997-4337-8009-8092e6c90318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283790754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5764ed58-61cc-4607-acac-dfbdde3e560c,host='devstack@QuobyteHD#QuobyteHD',id=371f5341-69a6-4552-bc8f-bed1defcbcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952aa482fa704c9cb2e248e26779cf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:24Z,use_quota=True,user_id='998fd553e6af4f8ea9ab67395c05abcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd29d984-18b5-475e-af85-d6fda9e471b6),volume_type_id=dd29d984-18b5-475e-af85-d6fda9e471b6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69712a0b-c9d1-4867-bba1-889a0cf42496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69712a0b-c9d1-4867-bba1-889a0cf42496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e4cf0b-ff84-4724-9481-2033876ce0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e4cf0b-ff84-4724-9481-2033876ce0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371f5341-69a6-4552-bc8f-bed1defcbcb2', 'volume_name': 'volume-371f5341-69a6-4552-bc8f-bed1defcbcb2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7c74fb-ffe8-4b71-aaa2-70a975bfc8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7c74fb-ffe8-4b71-aaa2-70a975bfc8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f4c956-d9f8-466e-8c41-12f1397cc5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Volume 371f5341-69a6-4552-bc8f-bed1defcbcb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371f5341-69a6-4552-bc8f-bed1defcbcb2', 'volume_size': 1} Jul 08 01:30:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:25 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b 1073741824" returned: 0 in 0.972s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:25 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b Jul 08 01:30:25 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:26 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b" returned: 0 in 0.727s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5764ed58-61cc-4607-acac-dfbdde3e560c,created_at=2026-07-07T23:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283790754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5764ed58-61cc-4607-acac-dfbdde3e560c,host='devstack@QuobyteHD#QuobyteHD',id=371f5341-69a6-4552-bc8f-bed1defcbcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952aa482fa704c9cb2e248e26779cf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:24Z,use_quota=True,user_id='998fd553e6af4f8ea9ab67395c05abcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd29d984-18b5-475e-af85-d6fda9e471b6),volume_type_id=dd29d984-18b5-475e-af85-d6fda9e471b6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Creating volume 371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:26 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f171691-2dd3-43bd-850f-c19c476bd256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27cb1fb-7491-4311-90fd-d6553535628b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:26 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 1073741824 Jul 08 01:30:26 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa022166-2032-48c6-ab63-d73fe14d24de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Volume volume-b27cb1fb-7491-4311-90fd-d6553535628b (b27cb1fb-7491-4311-90fd-d6553535628b): created successfully Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa022166-2032-48c6-ab63-d73fe14d24de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Flow 'volume_create_manager' (c99817c1-ef9d-44ab-8d6b-a92b3e8d10f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-df063917-5a5c-49b5-92ed-3b24486ad682 req-794723ad-5559-4ff0-bd70-f49f49ce77af tempest-VolumesSnapshotsTestJSON-1430932672 None] Created volume successfully. Jul 08 01:30:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:27 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 1073741824" returned: 0 in 1.356s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:27 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 Jul 08 01:30:27 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-bd1a6015-d70e-4fa1-be1a-35651679c955 req-73f428b6-9599-4495-bfbe-6e2c6d73e928 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:28 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2" returned: 0 in 0.705s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.521s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f4c956-d9f8-466e-8c41-12f1397cc5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371f5341-69a6-4552-bc8f-bed1defcbcb2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b4bfe-e86f-45fc-ae6c-d0f9eb12377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Creating offline snapshot 4ab60ed8-0091-4e5f-9c39-39a53f1c1cac of volume b27cb1fb-7491-4311-90fd-d6553535628b {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:30:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Volume volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 (371f5341-69a6-4552-bc8f-bed1defcbcb2): created successfully Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b4bfe-e86f-45fc-ae6c-d0f9eb12377c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Flow 'volume_create_manager' (4ce44cc4-1588-42f1-8d27-ee7b2ccde2a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4760220-a464-4189-b946-5d22d65b7a47]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-07c848a0-8532-464e-bcd9-e74e5bc0a94d tempest-GroupsV314Test-632247292 None] Created volume successfully. Jul 08 01:30:28 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b Jul 08 01:30:28 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:29 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b" returned: 0 in 0.897s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:29 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac 1G Jul 08 01:30:29 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:30 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac 1G" returned: 0 in 1.108s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b27cb1fb-7491-4311-90fd-d6553535628b -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:30 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b27cb1fb-7491-4311-90fd-d6553535628b -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac Jul 08 01:30:30 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:31 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b27cb1fb-7491-4311-90fd-d6553535628b -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac" returned: 0 in 0.793s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:31 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac is being set with open permissions: ugo+rw Jul 08 01:30:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:31 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac Jul 08 01:30:31 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:31 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac" returned: 0 in 0.699s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:32 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.info Jul 08 01:30:32 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:32 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.info" returned: 0 in 0.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:32 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.info is being set with open permissions: ugo+rw Jul 08 01:30:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:32 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.info Jul 08 01:30:32 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:33 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.info" returned: 0 in 0.695s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.109s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-bd1a6015-d70e-4fa1-be1a-35651679c955 req-73f428b6-9599-4495-bfbe-6e2c6d73e928 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.431s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc0d9da-689e-4782-88f5-dd55ceaeacdc]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-bd1a6015-d70e-4fa1-be1a-35651679c955 req-73f428b6-9599-4495-bfbe-6e2c6d73e928 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-1fc82a23-6f85-439c-9bd9-c51258ee61cd req-bd66b6aa-6dd2-42e7-a30a-ea49cd6cc4b8 tempest-VolumesSnapshotsTestJSON-1430932672 None] Create snapshot completed successfully Jul 08 01:30:33 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 Jul 08 01:30:33 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Acquiring lock "cinder-4ab60ed8-0091-4e5f-9c39-39a53f1c1cac-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-4ab60ed8-0091-4e5f-9c39-39a53f1c1cac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Acquiring lock "cinder-quobyte-b27cb1fb-7491-4311-90fd-d6553535628b" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-quobyte-b27cb1fb-7491-4311-90fd-d6553535628b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Acquiring lock "cinder-quobyte-4ab60ed8-0091-4e5f-9c39-39a53f1c1cac" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-quobyte-4ab60ed8-0091-4e5f-9c39-39a53f1c1cac" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Deleting offline snapshot 4ab60ed8-0091-4e5f-9c39-39a53f1c1cac of volume b27cb1fb-7491-4311-90fd-d6553535628b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] snapshot_file for this snap is: volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c80cede-9626-4b13-b1f5-2fc906b57861]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:34 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac Jul 08 01:30:34 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:34 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-bd1a6015-d70e-4fa1-be1a-35651679c955 req-73f428b6-9599-4495-bfbe-6e2c6d73e928 tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-bd1a6015-d70e-4fa1-be1a-35651679c955 req-73f428b6-9599-4495-bfbe-6e2c6d73e928 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.928s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:34 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Cloning volume 371f5341-69a6-4552-bc8f-bed1defcbcb2 to volume 17ed8704-f8e9-4c81-b604-129b938ba046 Jul 08 01:30:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-bd1a6015-d70e-4fa1-be1a-35651679c955 req-73f428b6-9599-4495-bfbe-6e2c6d73e928 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-0c90d190-6c2b-4edf-8506-c6800f7acea0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6110124-ab89-460d-b3cd-7558dfc7c53c', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:30:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Creating offline snapshot fe217cc1-b9fc-451c-96d5-e535a80cdf80 of volume 371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:30:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[043fbbf4-bfec-44e2-adc7-78fadb9361f3]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-bd1a6015-d70e-4fa1-be1a-35651679c955 req-73f428b6-9599-4495-bfbe-6e2c6d73e928 tempest-TestServerVolumeAttachmentScenario-1397312203 None] attachment_update completed successfully. Jul 08 01:30:34 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 Jul 08 01:30:34 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:34 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac" returned: 0 in 0.990s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b27cb1fb-7491-4311-90fd-d6553535628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:30:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffe292-5fdf-4c81-be8a-65e2d8b55196]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:35 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b Jul 08 01:30:35 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:35 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2" returned: 0 in 1.076s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:35 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 1G Jul 08 01:30:35 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:36 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b" returned: 0 in 1.235s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:36 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac Jul 08 01:30:36 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:36 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 1G" returned: 0 in 1.239s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:37 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 Jul 08 01:30:37 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:37 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac" returned: 0 in 1.157s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:37 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac Jul 08 01:30:37 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:37 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80" returned: 0 in 1.010s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:37 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:30:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:38 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 Jul 08 01:30:38 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:38 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b.4ab60ed8-0091-4e5f-9c39-39a53f1c1cac" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-quobyte-4ab60ed8-0091-4e5f-9c39-39a53f1c1cac" released by "_delete_snapshot" :: held 4.303s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-quobyte-b27cb1fb-7491-4311-90fd-d6553535628b" released by "delete_snapshot" :: held 4.339s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG cinder.quota [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Created reservations ['b7dd047b-2b57-4b58-bcac-c2b13c6f7a36', '5ebdcc40-6c79-445b-ba5b-1a70a05c44a0', 'a86cb286-41e0-4892-bf71-5254392a893e', '2dd040cc-3e65-4087-b2a6-d0a1a0a76196'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Delete snapshot completed successfully. Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-d45f6905-df70-4525-8a87-87f1622cda78 req-7d6d9cad-53db-46d5-885d-0398adbaeb1b tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-4ab60ed8-0091-4e5f-9c39-39a53f1c1cac-delete_snapshot" released by "delete_snapshot" :: held 4.605s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Acquiring lock "cinder-b27cb1fb-7491-4311-90fd-d6553535628b-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-b27cb1fb-7491-4311-90fd-d6553535628b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Acquiring lock "cinder-quobyte-b27cb1fb-7491-4311-90fd-d6553535628b" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-quobyte-b27cb1fb-7491-4311-90fd-d6553535628b" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b5a71b-86a6-4afc-a640-0b3d812f358d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:38 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80" returned: 0 in 0.926s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:38 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.info Jul 08 01:30:38 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:39 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b Jul 08 01:30:39 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:39 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.info" returned: 0 in 0.928s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:39 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:30:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:39 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.info Jul 08 01:30:39 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:40 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b" returned: 0 in 1.208s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:40 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b Jul 08 01:30:40 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:40 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.info" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Acquiring lock "cinder-quobyte-17ed8704-f8e9-4c81-b604-129b938ba046" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Lock "cinder-quobyte-17ed8704-f8e9-4c81-b604-129b938ba046" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] snapshot: fe217cc1-b9fc-451c-96d5-e535a80cdf80, volume: 17ed8704-f8e9-4c81-b604-129b938ba046, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f68207-a31c-46e0-b500-438a0eac8c03]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:40 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b27cb1fb-7491-4311-90fd-d6553535628b" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-quobyte-b27cb1fb-7491-4311-90fd-d6553535628b" released by "delete_volume" :: held 2.071s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:40 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 Jul 08 01:30:40 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:40 devstack cinder-volume[87204]: DEBUG cinder.quota [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Created reservations ['e7e1abee-31e2-49e6-90e6-c738707cc7e5', '2188801a-ef3a-4d49-ab53-7019aeb2b50c', '0f75b333-7cc0-4a7c-8f41-b1b966389e00', '054d4e2e-77c1-4f53-b123-cd7cd57676c1'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:41 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:30:41 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-da5bac72-90a5-4ee0-8cab-6955bbecdf5d req-e4d9498d-c2ec-454f-86b8-cc5754ee2ddf tempest-TestServerVolumeAttachmentScenario-1397312203 None] Terminate volume connection completed successfully. Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-da5bac72-90a5-4ee0-8cab-6955bbecdf5d req-e4d9498d-c2ec-454f-86b8-cc5754ee2ddf tempest-TestServerVolumeAttachmentScenario-1397312203 None] Deleting attachment c6110124-ab89-460d-b3cd-7558dfc7c53c. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:30:41 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80" returned: 0 in 1.013s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371f5341-69a6-4552-bc8f-bed1defcbcb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1bdfee-2a73-48ad-b18b-8759948e1b45]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:41 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.858s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG cinder.manager [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Deleted volume successfully. Jul 08 01:30:41 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 Jul 08 01:30:41 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-88176205-9303-4103-b920-459e42e28556 req-6c7858c4-7040-4555-b5ac-b3ea9402d481 tempest-VolumesSnapshotsTestJSON-1430932672 None] Lock "cinder-b27cb1fb-7491-4311-90fd-d6553535628b-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:42 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2" returned: 0 in 1.092s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:42 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:30:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:42 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 Jul 08 01:30:42 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-40eead61-1e17-476b-a3db-69407595071a req-5375025c-8d1d-4ffd-ac88-22503110f933 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Terminate volume connection completed successfully. Jul 08 01:30:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-40eead61-1e17-476b-a3db-69407595071a req-5375025c-8d1d-4ffd-ac88-22503110f933 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Deleting attachment cae1a11d-f001-4a70-b4bb-3b00738bdedf. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:30:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046" returned: 0 in 7.002s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6333bbe6-d660-487d-a140-fd1cca99eed7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:50 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 Jul 08 01:30:50 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:50 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=101,cinder:UPDATE=96,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:30:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a978617-4b1e-418d-8f05-94d4269cc62a tempest-GroupSnapshotsV319Test-2073398572 None] Group tempest-GroupSnapshotsV319Test-Group-1710055136: creating Jul 08 01:30:50 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=91,cinder:INSERT=30,cinder:UPDATE=89,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:30:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a978617-4b1e-418d-8f05-94d4269cc62a tempest-GroupSnapshotsV319Test-2073398572 None] Group tempest-GroupSnapshotsV319Test-Group-1710055136: created successfully Jul 08 01:30:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a978617-4b1e-418d-8f05-94d4269cc62a tempest-GroupSnapshotsV319Test-2073398572 None] Create group completed successfully. Jul 08 01:30:51 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2" returned: 0 in 1.396s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:51 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:30:51 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Converted 1024.00 MB image at 146.23 MB/s Jul 08 01:30:51 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:30:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:51 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 Jul 08 01:30:51 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:52 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046" returned: 0 in 1.061s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Lock "cinder-quobyte-17ed8704-f8e9-4c81-b604-129b938ba046" released by "_copy_volume_from_snapshot" :: held 11.697s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Acquiring lock "cinder-quobyte-fe217cc1-b9fc-451c-96d5-e535a80cdf80" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Lock "cinder-quobyte-fe217cc1-b9fc-451c-96d5-e535a80cdf80" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Deleting offline snapshot fe217cc1-b9fc-451c-96d5-e535a80cdf80 of volume 371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] snapshot_file for this snap is: volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[62229776-3876-4568-9830-4783bcaf6f34]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Flow 'volume_create_manager' (4ee2cd5f-4e1a-4377-ab21-cd67460d7625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f03cb2-c629-4024-b688-fa1d82da0a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f03cb2-c629-4024-b688-fa1d82da0a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166464818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fcaad91-5b0f-4ffc-838c-be76051218ef,host='devstack@QuobyteHD#QuobyteHD',id=409d63c1-f2ac-4fae-b75e-069a8a9243f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8020237138462abc50473527b92f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:52Z,use_quota=True,user_id='4a546a9d44044d65b3b53e41125311b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df95a9b9-aba4-4982-be3f-ff038424a147),volume_type_id=df95a9b9-aba4-4982-be3f-ff038424a147)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc92c599-0327-47a1-a2ad-7fcb0b08c6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc92c599-0327-47a1-a2ad-7fcb0b08c6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b811c4-5e09-403b-9f2e-f13fce9eeef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b811c4-5e09-403b-9f2e-f13fce9eeef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409d63c1-f2ac-4fae-b75e-069a8a9243f3', 'volume_name': 'volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24053be-3104-4ac0-bf7f-c39631b18af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:52 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 Jul 08 01:30:52 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24053be-3104-4ac0-bf7f-c39631b18af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b86439-58a0-4baf-8602-7be80b58ac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Volume 409d63c1-f2ac-4fae-b75e-069a8a9243f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3', 'volume_size': 1} Jul 08 01:30:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:53 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80" returned: 0 in 0.999s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371f5341-69a6-4552-bc8f-bed1defcbcb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90a0dc3-43b0-405d-a403-5b3ec0fb74b1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:53 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:30:53 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:53 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 Jul 08 01:30:53 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:54 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.897s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:30:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:30:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:30:54 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2" returned: 0 in 1.077s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:54 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 Jul 08 01:30:54 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:55 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80" returned: 0 in 0.832s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:55 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80 Jul 08 01:30:55 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:56 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2.fe217cc1-b9fc-451c-96d5-e535a80cdf80" returned: 0 in 0.830s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Lock "cinder-quobyte-fe217cc1-b9fc-451c-96d5-e535a80cdf80" released by "_delete_snapshot" :: held 3.944s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.888s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.726s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fcaad91-5b0f-4ffc-838c-be76051218ef,created_at=2026-07-07T23:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166464818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fcaad91-5b0f-4ffc-838c-be76051218ef,host='devstack@QuobyteHD#QuobyteHD',id=409d63c1-f2ac-4fae-b75e-069a8a9243f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8020237138462abc50473527b92f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:52Z,use_quota=True,user_id='4a546a9d44044d65b3b53e41125311b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df95a9b9-aba4-4982-be3f-ff038424a147),volume_type_id=df95a9b9-aba4-4982-be3f-ff038424a147)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Creating volume 409d63c1-f2ac-4fae-b75e-069a8a9243f3 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:56 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:30:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:56 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 1073741824 Jul 08 01:30:56 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-87154219-3ddd-4329-98d6-07caa1abb98e tempest-GroupsV314Test-632247292 None] Create group from source-group-5764ed58-61cc-4607-acac-dfbdde3e560c completed successfully. Jul 08 01:30:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Acquiring lock "cinder-quobyte-17ed8704-f8e9-4c81-b604-129b938ba046" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Lock "cinder-quobyte-17ed8704-f8e9-4c81-b604-129b938ba046" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f10d15-6799-4e1f-ab60-3c0aa9a83ecb]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:57 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 1073741824" returned: 0 in 1.259s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:57 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 Jul 08 01:30:57 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:57 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 Jul 08 01:30:57 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "cinder-0c90d190-6c2b-4edf-8506-c6800f7acea0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "cinder-0c90d190-6c2b-4edf-8506-c6800f7acea0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "cinder-quobyte-0c90d190-6c2b-4edf-8506-c6800f7acea0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "cinder-quobyte-0c90d190-6c2b-4edf-8506-c6800f7acea0" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c26cae-edd9-421d-9f01-9730804c441e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:58 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 Jul 08 01:30:58 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:58 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046" returned: 0 in 1.218s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:58 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3" returned: 0 in 1.048s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] <== create_volume: return (2381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.388s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:58 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046 Jul 08 01:30:58 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b86439-58a0-4baf-8602-7be80b58ac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5caaf18-6bd9-4105-a2d8-c1210a85684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Volume volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 (409d63c1-f2ac-4fae-b75e-069a8a9243f3): created successfully Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5caaf18-6bd9-4105-a2d8-c1210a85684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Flow 'volume_create_manager' (4ee2cd5f-4e1a-4377-ab21-cd67460d7625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5d66abe3-3335-42d9-9d37-1b511cb8c8a0 tempest-GroupSnapshotsV319Test-2073398572 None] Created volume successfully. Jul 08 01:30:59 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0" returned: 0 in 0.939s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:59 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0 Jul 08 01:30:59 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:59 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-17ed8704-f8e9-4c81-b604-129b938ba046" returned: 0 in 0.790s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Lock "cinder-quobyte-17ed8704-f8e9-4c81-b604-129b938ba046" released by "delete_volume" :: held 2.074s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Created reservations ['3f89952b-1d2f-443d-8cd8-4e338390b784'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:59 devstack cinder-volume[87204]: WARNING cinder.quota [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-11995502 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-11995502, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:30:59 devstack cinder-volume[87204]: WARNING cinder.quota [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-11995502 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-11995502, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Created reservations ['61625b88-fe34-4515-b8cc-d358fa3be4a9', '79f5dffe-4e35-4feb-b047-96000bda38ab', '2ea9b7d6-c142-4fb7-8b2a-222067b74049', '8b3c4c28-7a1b-4415-9d7f-091bba22df4b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:59 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:30:59 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] GroupSnapshot 0d42db66-7b8b-40cf-83ab-39e245f96aee: creating. Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Group snapshot 0d42db66-7b8b-40cf-83ab-39e245f96aee: creating. {{(pid=87204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Creating offline snapshot 306fb21f-361f-4187-b813-1549a9721e6f of volume 409d63c1-f2ac-4fae-b75e-069a8a9243f3 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec55082f-0ebf-48dc-b5d3-32bc8792ee23]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:00 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0c90d190-6c2b-4edf-8506-c6800f7acea0" returned: 0 in 0.886s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "cinder-quobyte-0c90d190-6c2b-4edf-8506-c6800f7acea0" released by "delete_volume" :: held 1.895s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Created reservations ['955a65e4-3762-4abf-96a0-f729c65e4c95', 'dce35bb9-9bc3-480c-ba97-094df7ede9cb', '2f176ae7-7d5a-48a0-b2e1-5e2fc3aec415', 'de887309-4333-4e3a-8de0-2292b6522e30'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:00 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 Jul 08 01:31:00 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Acquiring lock "cinder-quobyte-371f5341-69a6-4552-bc8f-bed1defcbcb2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Lock "cinder-quobyte-371f5341-69a6-4552-bc8f-bed1defcbcb2" acquired by "delete_volume" :: waited 0.049s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "cinder-85313076-0d03-46a8-a9bb-3fe2049fcdbb-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d49e073-3a76-4a0f-b1d2-b015a6cf4c6e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "cinder-85313076-0d03-46a8-a9bb-3fe2049fcdbb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:00 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:00 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "cinder-quobyte-85313076-0d03-46a8-a9bb-3fe2049fcdbb" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "cinder-quobyte-85313076-0d03-46a8-a9bb-3fe2049fcdbb" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fc752f-3c27-4853-84e3-f48707dfe4b7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:00 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 Jul 08 01:31:00 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:00 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb Jul 08 01:31:00 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:01 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.159s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-66f91b40-6096-4306-8212-3ca17f24be2f tempest-GroupsV314Test-632247292 None] Delete group completed successfully. Jul 08 01:31:01 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3" returned: 0 in 1.326s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:01 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f 1G Jul 08 01:31:01 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:01 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.966s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Deleted volume successfully. Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-418ec2eb-8daa-46ca-800d-a56994043274 tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "cinder-0c90d190-6c2b-4edf-8506-c6800f7acea0-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:01 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2" returned: 0 in 1.236s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:01 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2 Jul 08 01:31:01 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:01 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb" returned: 0 in 1.123s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:01 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb Jul 08 01:31:01 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:02 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f 1G" returned: 0 in 1.000s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:02 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f Jul 08 01:31:02 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:02 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85313076-0d03-46a8-a9bb-3fe2049fcdbb" returned: 0 in 0.733s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "cinder-quobyte-85313076-0d03-46a8-a9bb-3fe2049fcdbb" released by "delete_volume" :: held 1.919s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:02 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-371f5341-69a6-4552-bc8f-bed1defcbcb2" returned: 0 in 0.883s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Lock "cinder-quobyte-371f5341-69a6-4552-bc8f-bed1defcbcb2" released by "delete_volume" :: held 2.233s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Created reservations ['f22a7e25-652f-4320-862c-a02bde4cec75', 'f74c643e-77b6-4594-844a-898e7050f478', 'ce1fec05-daeb-4b7a-a93c-511ed6bf6b03', 'afc51a9e-b3f9-4131-8a9e-3ffdfda59518'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Created reservations ['f082deb8-175f-4d99-8b0d-11c2c40dad86'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:02 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:02 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Created reservations ['438c4cc8-4332-40db-be21-e46f5504008a', 'a3c1a6cb-353d-4743-bfba-cd5b3b54601e', '6d5fab74-a7e1-421b-8307-9cc179a011ad', '4f590fa8-5531-47c4-89e7-041e0cbd1044'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:03 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:03 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:03 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f" returned: 0 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:03 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:03 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f Jul 08 01:31:03 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:03 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.836s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Deleted volume successfully. Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4df0674a-b035-4a74-ba9d-b04b3a8dbaec tempest-TestServerVolumeAttachmentScenario-1397312203 None] Lock "cinder-85313076-0d03-46a8-a9bb-3fe2049fcdbb-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:03 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.837s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-edfadf1d-99bc-4c59-8fc6-b77c141fec84 tempest-GroupsV314Test-632247292 None] Delete group completed successfully. Jul 08 01:31:04 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f" returned: 0 in 0.829s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:04 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.info Jul 08 01:31:04 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:04 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.info" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:04 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:31:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:04 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.info Jul 08 01:31:04 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:05 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.info" returned: 0 in 0.807s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.641s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3b5c0439-0182-48f4-9fd1-5d4a96158d78 tempest-GroupSnapshotsV319Test-2073398572 None] group_snapshot 0d42db66-7b8b-40cf-83ab-39e245f96aee: created successfully Jul 08 01:31:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] group_snapshot 0d42db66-7b8b-40cf-83ab-39e245f96aee: deleting Jul 08 01:31:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] group_snapshot 0d42db66-7b8b-40cf-83ab-39e245f96aee: deleting {{(pid=87204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:31:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Acquiring lock "cinder-quobyte-409d63c1-f2ac-4fae-b75e-069a8a9243f3" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "cinder-quobyte-409d63c1-f2ac-4fae-b75e-069a8a9243f3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Acquiring lock "cinder-quobyte-306fb21f-361f-4187-b813-1549a9721e6f" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "cinder-quobyte-306fb21f-361f-4187-b813-1549a9721e6f" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Deleting offline snapshot 306fb21f-361f-4187-b813-1549a9721e6f of volume 409d63c1-f2ac-4fae-b75e-069a8a9243f3 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:31:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] snapshot_file for this snap is: volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:31:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97e287e-aa53-45b9-9821-2e046be327d1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:07 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f Jul 08 01:31:07 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:08 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f" returned: 0 in 1.317s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:31:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5f256f-3c69-448b-8017-37259922aa7d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:08 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 Jul 08 01:31:08 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:09 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3" returned: 0 in 1.159s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:09 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f Jul 08 01:31:09 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:10 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f" returned: 0 in 1.181s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:10 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f Jul 08 01:31:10 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:11 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3.306fb21f-361f-4187-b813-1549a9721e6f" returned: 0 in 0.895s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "cinder-quobyte-306fb21f-361f-4187-b813-1549a9721e6f" released by "_delete_snapshot" :: held 4.731s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "cinder-quobyte-409d63c1-f2ac-4fae-b75e-069a8a9243f3" released by "delete_snapshot" :: held 4.777s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:11 devstack cinder-volume[87204]: WARNING cinder.quota [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1719313341 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1719313341, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:31:11 devstack cinder-volume[87204]: WARNING cinder.quota [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1719313341 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1719313341, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:31:11 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] Created reservations ['7bbb8846-a3f4-4e36-a62a-c2f95e8863ab', '8c88b3e9-6e71-44b6-83c3-1e21ae351b16', '08f0b0c4-8a51-4478-9f37-0bc7223007e1', '047bb100-302b-4c33-b68f-c78d156ea13d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8f06211c-bffd-4bf7-868a-c50bc1add0b3 tempest-GroupSnapshotsV319Test-2073398572 None] group_snapshot 0d42db66-7b8b-40cf-83ab-39e245f96aee: deleted successfully Jul 08 01:31:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Acquiring lock "cinder-quobyte-409d63c1-f2ac-4fae-b75e-069a8a9243f3" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "cinder-quobyte-409d63c1-f2ac-4fae-b75e-069a8a9243f3" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b2b65-4cab-4674-8aa6-6c68e93c91cd]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:13 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 Jul 08 01:31:13 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:14 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3" returned: 0 in 1.026s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:14 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3 Jul 08 01:31:14 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:15 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-409d63c1-f2ac-4fae-b75e-069a8a9243f3" returned: 0 in 1.048s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "cinder-quobyte-409d63c1-f2ac-4fae-b75e-069a8a9243f3" released by "delete_volume" :: held 2.221s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Created reservations ['8f89c819-8e1c-4f50-bded-57eec4f4af55'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:15 devstack cinder-volume[87204]: WARNING cinder.quota [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1719313341 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1719313341, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Created reservations ['25d7a3ce-c7fe-4e63-8d24-9b960cfacf56', '7c6d18ed-bfdd-438d-aed5-79de87686249', '5f2de144-4ed2-4052-8207-dd01b5760099', 'b38fa96f-44d7-4f37-b139-594dc75beb1f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:15 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:15 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:17 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.445s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:17 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8769a458-23d1-4ff8-8cb0-d22e096e26d7 tempest-GroupSnapshotsV319Test-2073398572 None] Delete group completed successfully. Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (e3591666-91eb-4054-be50-1ca903df1e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b7a7f3-5912-4afc-89f2-803fd98d99b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b7a7f3-5912-4afc-89f2-803fd98d99b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7637861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a71674-178e-423f-8c37-5749042e6a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:22Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a067e1-17b0-4677-97be-12fd2c068ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a067e1-17b0-4677-97be-12fd2c068ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b28a0-6fa5-4113-a902-5da71632e367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b28a0-6fa5-4113-a902-5da71632e367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a71674-178e-423f-8c37-5749042e6a79', 'volume_name': 'volume-94a71674-178e-423f-8c37-5749042e6a79', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abeab19-5fcf-49f1-8b6a-2b400f98136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abeab19-5fcf-49f1-8b6a-2b400f98136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4548d7-160f-4075-b903-ef8d26f1bddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:22 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume 94a71674-178e-423f-8c37-5749042e6a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a71674-178e-423f-8c37-5749042e6a79', 'volume_size': 1} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7637861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a71674-178e-423f-8c37-5749042e6a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:22Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Creating volume 94a71674-178e-423f-8c37-5749042e6a79 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:22 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:22 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 1073741824 Jul 08 01:31:22 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Flow 'volume_create_manager' (558cf6e9-9cd8-4f6a-8538-0c70341cb19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ac12ba-baf6-478b-8f6c-9ab1495dd7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (154eb5e7-0cb9-4024-bff6-6b7b30577f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8a83a0-76f3-4a01-aa34-04033f77d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ac12ba-baf6-478b-8f6c-9ab1495dd7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1410716081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70427f71-4fbd-41e8-83ff-a39ddbe8153f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed7f4e4fa3f476f9d701306ac3fbe80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:23Z,use_quota=True,user_id='6208e9b7baed4ce39856bf7f7df8d9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f8a2ab0-fcc4-4420-b2c0-d0d0866edea5),volume_type_id=0f8a2ab0-fcc4-4420-b2c0-d0d0866edea5)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0199ee0b-54b5-45ec-8780-e9cad1162b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0199ee0b-54b5-45ec-8780-e9cad1162b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bca9f23-5d42-40f2-9980-4a8e10cf185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bca9f23-5d42-40f2-9980-4a8e10cf185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70427f71-4fbd-41e8-83ff-a39ddbe8153f', 'volume_name': 'volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e08b5b8-ea19-4876-8808-79cca2bbf064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e08b5b8-ea19-4876-8808-79cca2bbf064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ee1123-3339-4614-ad4e-f49c18222124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Volume 70427f71-4fbd-41e8-83ff-a39ddbe8153f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f', 'volume_size': 1} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8a83a0-76f3-4a01-aa34-04033f77d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1826034550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2b0810-ecf4-41f1-9ee1-36ec52866c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:23Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcb9857-d513-4571-8c61-bfc1b3428341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcb9857-d513-4571-8c61-bfc1b3428341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ac899a-f86e-4d5f-b1e9-a1cc02ed70a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ac899a-f86e-4d5f-b1e9-a1cc02ed70a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2b0810-ecf4-41f1-9ee1-36ec52866c48', 'volume_name': 'volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e00ba3-bfdf-4ece-9d2a-8969948a4aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e00ba3-bfdf-4ece-9d2a-8969948a4aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2e82ec-3e6a-4c6f-8452-23398d130bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Volume 2e2b0810-ecf4-41f1-9ee1-36ec52866c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48', 'volume_size': 1} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:23 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 1073741824" returned: 0 in 1.247s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:23 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 Jul 08 01:31:23 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:24 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.169s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1410716081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70427f71-4fbd-41e8-83ff-a39ddbe8153f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed7f4e4fa3f476f9d701306ac3fbe80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:23Z,use_quota=True,user_id='6208e9b7baed4ce39856bf7f7df8d9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f8a2ab0-fcc4-4420-b2c0-d0d0866edea5),volume_type_id=0f8a2ab0-fcc4-4420-b2c0-d0d0866edea5)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Creating volume 70427f71-4fbd-41e8-83ff-a39ddbe8153f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:24 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:24 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f 1073741824 Jul 08 01:31:24 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4548d7-160f-4075-b903-ef8d26f1bddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a71674-178e-423f-8c37-5749042e6a79', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1e076d-2ac3-46af-aaca-68e880ee0f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume volume-94a71674-178e-423f-8c37-5749042e6a79 (94a71674-178e-423f-8c37-5749042e6a79): created successfully Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1e076d-2ac3-46af-aaca-68e880ee0f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (e3591666-91eb-4054-be50-1ca903df1e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cda34b30-7712-473a-a8fe-c6f17e45b7d5 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created volume successfully. Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Flow 'volume_create_manager' (beb09722-fbf5-4e48-b881-d8044109d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bef88c-a9dc-46d9-9695-5c1845330a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bef88c-a9dc-46d9-9695-5c1845330a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1821615576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7f58b6-40b2-4215-aaec-165bb6bb1a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3699e54d288b412dbbf410c3db6a949a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:25Z,use_quota=True,user_id='d1081d6de9e44c8dad33b421e534369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f288e3f-bb0c-45f3-9ae2-395593d952ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f288e3f-bb0c-45f3-9ae2-395593d952ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3658b1e8-17e3-4194-81c3-66bd4ded9507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3658b1e8-17e3-4194-81c3-66bd4ded9507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e7f58b6-40b2-4215-aaec-165bb6bb1a96', 'volume_name': 'volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4195a17-5baf-4be9-84d7-4b4ba1d29611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4195a17-5baf-4be9-84d7-4b4ba1d29611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af41ca5-b370-4fd6-8b8b-dc0844bd7e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96', 'volume_size': 1} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:25 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f 1073741824" returned: 0 in 1.166s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:25 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f Jul 08 01:31:25 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:26 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f" returned: 0 in 0.814s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.152s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1826034550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2b0810-ecf4-41f1-9ee1-36ec52866c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:23Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Creating volume 2e2b0810-ecf4-41f1-9ee1-36ec52866c48 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:26 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ee1123-3339-4614-ad4e-f49c18222124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:26 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 1073741824 Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3871e0-7dfe-498d-abe2-26c584d92c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:26 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Volume volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f (70427f71-4fbd-41e8-83ff-a39ddbe8153f): created successfully Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3871e0-7dfe-498d-abe2-26c584d92c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Flow 'volume_create_manager' (558cf6e9-9cd8-4f6a-8538-0c70341cb19b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-689e671e-738f-4c29-833a-0d1690e5f099 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Created volume successfully. Jul 08 01:31:27 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 1073741824" returned: 0 in 1.222s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54bdd657-14f4-4b3f-b097-93067d4b5543 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54bdd657-14f4-4b3f-b097-93067d4b5543 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54bdd657-14f4-4b3f-b097-93067d4b5543 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54bdd657-14f4-4b3f-b097-93067d4b5543 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54bdd657-14f4-4b3f-b097-93067d4b5543 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54bdd657-14f4-4b3f-b097-93067d4b5543 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:28 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:28 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:28 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 Jul 08 01:31:28 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:28 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48" returned: 0 in 0.753s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.616s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1821615576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7f58b6-40b2-4215-aaec-165bb6bb1a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3699e54d288b412dbbf410c3db6a949a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:25Z,use_quota=True,user_id='d1081d6de9e44c8dad33b421e534369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Creating volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:28 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:28 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54bdd657-14f4-4b3f-b097-93067d4b5543 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.856s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-54bdd657-14f4-4b3f-b097-93067d4b5543 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:28 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 1073741824 Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2e82ec-3e6a-4c6f-8452-23398d130bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:28 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49c6b32-ef16-4c7b-b0ac-d48d913c25c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-54bdd657-14f4-4b3f-b097-93067d4b5543 tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Retype volume completed successfully. Jul 08 01:31:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Volume volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 (2e2b0810-ecf4-41f1-9ee1-36ec52866c48): created successfully Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49c6b32-ef16-4c7b-b0ac-d48d913c25c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (154eb5e7-0cb9-4024-bff6-6b7b30577f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-07bd546e-cc46-4ee4-9101-2508cf345055 tempest-VolumesActionsTest-1959802335 None] Created volume successfully. Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Acquiring lock "cinder-70427f71-4fbd-41e8-83ff-a39ddbe8153f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "cinder-70427f71-4fbd-41e8-83ff-a39ddbe8153f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Acquiring lock "cinder-quobyte-70427f71-4fbd-41e8-83ff-a39ddbe8153f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "cinder-quobyte-70427f71-4fbd-41e8-83ff-a39ddbe8153f" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44fe705-d777-413d-a7a5-47704fd1f295]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a73c89d-795f-4c05-b10b-6d35f7185984 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48" by "attach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a73c89d-795f-4c05-b10b-6d35f7185984 tempest-VolumesActionsTest-1959802335 None] Lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48" acquired by "attach_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0a73c89d-795f-4c05-b10b-6d35f7185984 tempest-VolumesActionsTest-1959802335 None] Attaching volume 2e2b0810-ecf4-41f1-9ee1-36ec52866c48 to instance ef0cb1b4-50e5-4d43-abe6-6913057a5c82 at mountpoint /dev/vdb on host None. Jul 08 01:31:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0a73c89d-795f-4c05-b10b-6d35f7185984 tempest-VolumesActionsTest-1959802335 None] Attach volume completed successfully. Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a73c89d-795f-4c05-b10b-6d35f7185984 tempest-VolumesActionsTest-1959802335 None] Lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48" released by "attach_volume" :: held 0.137s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:29 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f Jul 08 01:31:29 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:29 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 1073741824" returned: 0 in 1.176s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:30 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 Jul 08 01:31:30 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:30 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f" returned: 0 in 1.197s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:30 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f Jul 08 01:31:30 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fece5d91-4698-4c42-b3aa-d06fb62d893f tempest-VolumesActionsTest-416766462 None] Terminate volume connection completed successfully. Jul 08 01:31:31 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" returned: 0 in 0.983s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.686s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af41ca5-b370-4fd6-8b8b-dc0844bd7e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b376de4-d59b-4725-8d67-c313d2f66a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Creating offline snapshot 006c5878-8d45-423d-96b1-381170a81f66 of volume 94a71674-178e-423f-8c37-5749042e6a79 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:31:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Volume volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 (1e7f58b6-40b2-4215-aaec-165bb6bb1a96): created successfully Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b376de4-d59b-4725-8d67-c313d2f66a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Flow 'volume_create_manager' (beb09722-fbf5-4e48-b881-d8044109d86e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7074f611-cd5a-43f7-909e-a470034a57e9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-00375b54-60ea-4d0a-a0ec-9da21d4e2f33 tempest-SnapshotsActionsTest-467489153 None] Created volume successfully. Jul 08 01:31:31 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 Jul 08 01:31:31 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:31 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-70427f71-4fbd-41e8-83ff-a39ddbe8153f" returned: 0 in 0.857s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fece5d91-4698-4c42-b3aa-d06fb62d893f tempest-VolumesActionsTest-416766462 None] Acquiring lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48-detach_volume" by "detach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "cinder-quobyte-70427f71-4fbd-41e8-83ff-a39ddbe8153f" released by "delete_volume" :: held 2.184s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fece5d91-4698-4c42-b3aa-d06fb62d893f tempest-VolumesActionsTest-416766462 None] Lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fece5d91-4698-4c42-b3aa-d06fb62d893f tempest-VolumesActionsTest-416766462 None] Detaching volume 2e2b0810-ecf4-41f1-9ee1-36ec52866c48 from instance ef0cb1b4-50e5-4d43-abe6-6913057a5c82. Jul 08 01:31:31 devstack cinder-volume[87204]: WARNING cinder.quota [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:31:31 devstack cinder-volume[87204]: WARNING cinder.quota [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Created reservations ['6188d806-662d-4be7-91ff-65a6c99529b3', 'cbb52bb5-ea86-4cc4-b65d-44c30c494831', 'e5c732d2-2270-4ff3-a07d-fa15df12d75a', '532ab92e-44a2-446e-91c2-910cb72e5e97'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fece5d91-4698-4c42-b3aa-d06fb62d893f tempest-VolumesActionsTest-416766462 None] Detach volume completed successfully. Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fece5d91-4698-4c42-b3aa-d06fb62d893f tempest-VolumesActionsTest-416766462 None] Lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48-detach_volume" released by "detach_volume" :: held 0.210s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:31 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:31 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:32 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79" returned: 0 in 1.216s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1f797751-df34-4ad2-8515-46aadaa35380 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48-detach_volume" by "detach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:32 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 1G Jul 08 01:31:32 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1f797751-df34-4ad2-8515-46aadaa35380 tempest-VolumesActionsTest-1959802335 None] Lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1f797751-df34-4ad2-8515-46aadaa35380 tempest-VolumesActionsTest-1959802335 None] Volume detach called, but volume not attached. Jul 08 01:31:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1f797751-df34-4ad2-8515-46aadaa35380 tempest-VolumesActionsTest-1959802335 None] Lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:32 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.988s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:32 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Deleted volume successfully. Jul 08 01:31:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c360bf-3cec-432c-82b7-9068f5519a7a tempest-VolumeRetypeWithoutMigrationTest-1094423271 None] Lock "cinder-70427f71-4fbd-41e8-83ff-a39ddbe8153f-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "cinder-quobyte-2e2b0810-ecf4-41f1-9ee1-36ec52866c48" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Lock "cinder-quobyte-2e2b0810-ecf4-41f1-9ee1-36ec52866c48" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c464c45-e216-4077-8626-e227ee6d77c3]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:33 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 Jul 08 01:31:33 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:33 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 1G" returned: 0 in 1.042s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a71674-178e-423f-8c37-5749042e6a79 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:33 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a71674-178e-423f-8c37-5749042e6a79 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 Jul 08 01:31:33 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:34 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48" returned: 0 in 0.861s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:34 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48 Jul 08 01:31:34 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:34 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a71674-178e-423f-8c37-5749042e6a79 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66" returned: 0 in 0.758s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:34 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 is being set with open permissions: ugo+rw Jul 08 01:31:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:34 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 Jul 08 01:31:34 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:34 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2e2b0810-ecf4-41f1-9ee1-36ec52866c48" returned: 0 in 0.764s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Lock "cinder-quobyte-2e2b0810-ecf4-41f1-9ee1-36ec52866c48" released by "delete_volume" :: held 1.676s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:34 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:34 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.info Jul 08 01:31:34 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:34 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Created reservations ['263c856b-ced0-4784-9d2f-4d3f31f3c9d6', '00ab48c4-77f0-413b-90b7-0037057b77ae', 'f775fc20-e55f-4719-8db4-bfc27bcf2b2e', '3288ae6c-2c63-4ed9-9992-a13b4fac3eef'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:35 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:35 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:35 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.info" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:35 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.info is being set with open permissions: ugo+rw Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:35 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.info Jul 08 01:31:35 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:35 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Deleted volume successfully. Jul 08 01:31:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3bd850f-0ac2-49c9-9b19-6d4441c11b85 tempest-VolumesActionsTest-1959802335 None] Lock "cinder-2e2b0810-ecf4-41f1-9ee1-36ec52866c48-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:36 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.info" returned: 0 in 0.757s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.540s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.313s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Creating offline snapshot d44f242a-95e1-4ef7-a5c3-da8b01d27175 of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:31:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a43daf0-33b7-4a31-b4f0-7a36d6bdd84e tempest-CreateVolumesFromSnapshotTest-2132190648 None] Create snapshot completed successfully Jul 08 01:31:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1215c1-9199-431e-9988-5cc58b286972]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:36 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 Jul 08 01:31:36 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:37 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" returned: 0 in 1.116s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:37 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 1G Jul 08 01:31:37 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (77a97125-14c7-4053-bbba-0a8c6829f031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25ba764-76f9-4ed0-80d9-3b9a47dd8995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25ba764-76f9-4ed0-80d9-3b9a47dd8995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987938437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3235cdeb-2268-4716-8a3e-b43985cf99d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:38Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5cbe23-0c92-438b-a5ed-f17aed9999c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5cbe23-0c92-438b-a5ed-f17aed9999c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383bac2a-d68a-4413-9702-d36091cb9490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383bac2a-d68a-4413-9702-d36091cb9490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3235cdeb-2268-4716-8a3e-b43985cf99d6', 'volume_name': 'volume-3235cdeb-2268-4716-8a3e-b43985cf99d6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9369edb5-411a-4866-8af3-d6632584a3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9369edb5-411a-4866-8af3-d6632584a3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bef084b-fc60-4f20-93cc-88fa6e901520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:38 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume 3235cdeb-2268-4716-8a3e-b43985cf99d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3235cdeb-2268-4716-8a3e-b43985cf99d6', 'volume_size': 1} Jul 08 01:31:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (1cb30d8d-46dc-4d7a-be70-1efd1ab6d554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:39 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e8700e-c00e-47a7-8349-3e341a18c21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 1G" returned: 0 in 1.448s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e8700e-c00e-47a7-8349-3e341a18c21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1815078304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a300ecd3-055b-4c2e-99de-412eb77c4bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:39Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7c842b-2b27-442b-96a8-82002cbb0a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7c842b-2b27-442b-96a8-82002cbb0a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:39 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0256343-8e8c-43dd-af1f-987209418568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0256343-8e8c-43dd-af1f-987209418568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a300ecd3-055b-4c2e-99de-412eb77c4bbc', 'volume_name': 'volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cf6a95-38b7-4644-b449-de49b87f138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cf6a95-38b7-4644-b449-de49b87f138f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d27cf-bf65-4051-b759-c06f7ede2b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume a300ecd3-055b-4c2e-99de-412eb77c4bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc', 'volume_size': 1} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (cb33163f-b99f-4042-b533-c42d79495491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabe5b3b-4096-48cb-ba24-d8c36b8f013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabe5b3b-4096-48cb-ba24-d8c36b8f013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813857917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4803e7c-24c7-4972-ade3-ec93368266a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:40Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a61a25-50be-4a0b-af12-76ed006cf2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a61a25-50be-4a0b-af12-76ed006cf2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1c9ac9-4e4a-424c-878a-fcbd13d3c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1c9ac9-4e4a-424c-878a-fcbd13d3c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4803e7c-24c7-4972-ade3-ec93368266a6', 'volume_name': 'volume-a4803e7c-24c7-4972-ade3-ec93368266a6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7595a860-f309-4989-844e-1bc2cbd3fc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7595a860-f309-4989-844e-1bc2cbd3fc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778334d4-319e-412b-b740-d33648927b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume a4803e7c-24c7-4972-ade3-ec93368266a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4803e7c-24c7-4972-ade3-ec93368266a6', 'volume_size': 1} Jul 08 01:31:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:40 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (918ed6da-6eec-429a-a40c-b27cbb716280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7bb4f4-ef5a-480b-bd1b-ea2b5fb956d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 1.040s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:40 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 is being set with open permissions: ugo+rw Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7bb4f4-ef5a-480b-bd1b-ea2b5fb956d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-417741561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eda4bc1-7dbe-472b-be89-f1cf0ad15d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:40Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:40 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e357d275-c84e-4160-9cbd-d05c2010bca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e357d275-c84e-4160-9cbd-d05c2010bca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283bbb5-7e5a-4f55-bec1-31095097b4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283bbb5-7e5a-4f55-bec1-31095097b4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eda4bc1-7dbe-472b-be89-f1cf0ad15d12', 'volume_name': 'volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e4de14-fb30-44ca-ab46-44415d4a3a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e4de14-fb30-44ca-ab46-44415d4a3a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269799c0-36c7-4de2-830b-7602e9b6a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume 3eda4bc1-7dbe-472b-be89-f1cf0ad15d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12', 'volume_size': 1} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (7a44e901-6477-498b-a8af-41f6f230e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c487113c-db41-43d2-b7f0-ced5762bcb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c487113c-db41-43d2-b7f0-ced5762bcb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506232209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e226bcc1-df02-4c5c-8744-3078fce21353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:41Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61de27e4-5666-478a-892b-b536893ca898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61de27e4-5666-478a-892b-b536893ca898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e618646e-3f7f-4a10-83c1-5f905b77520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e618646e-3f7f-4a10-83c1-5f905b77520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e226bcc1-df02-4c5c-8744-3078fce21353', 'volume_name': 'volume-e226bcc1-df02-4c5c-8744-3078fce21353', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45875e46-c065-4c81-b493-6912531bae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45875e46-c065-4c81-b493-6912531bae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ae12f1-6069-428b-bace-ec6b9ce455c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume e226bcc1-df02-4c5c-8744-3078fce21353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e226bcc1-df02-4c5c-8744-3078fce21353', 'volume_size': 1} Jul 08 01:31:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:41 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 0.810s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:41 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.info Jul 08 01:31:41 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:41 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.info" returned: 0 in 0.803s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:41 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.info is being set with open permissions: ugo+rw Jul 08 01:31:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:41 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.info Jul 08 01:31:41 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:42 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.info" returned: 0 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.190s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.290s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987938437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3235cdeb-2268-4716-8a3e-b43985cf99d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:38Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Creating volume 3235cdeb-2268-4716-8a3e-b43985cf99d6 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:42 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:42 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 1073741824 Jul 08 01:31:42 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c55a0331-4b6b-47fc-b848-0c9f05fb85f3 tempest-SnapshotsActionsTest-467489153 None] Create snapshot completed successfully Jul 08 01:31:43 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 1073741824" returned: 0 in 1.097s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:43 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 Jul 08 01:31:43 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (dabe6d46-28a3-4589-a4cc-f03c2ad32f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c202ecd4-12c5-46fe-84e3-669e436ad09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c202ecd4-12c5-46fe-84e3-669e436ad09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304648526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49959ea8-0261-407a-b16c-cd7abfcf9aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:44Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cde3369-7216-45fc-9716-84bfdfee02e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cde3369-7216-45fc-9716-84bfdfee02e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10498a3-621e-4e04-aec2-7a96eee17ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10498a3-621e-4e04-aec2-7a96eee17ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49959ea8-0261-407a-b16c-cd7abfcf9aa5', 'volume_name': 'volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b572f2-f69b-4c45-9668-240520371c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b572f2-f69b-4c45-9668-240520371c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a7a298-476d-4a1f-90b2-f1ad47346d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Volume 49959ea8-0261-407a-b16c-cd7abfcf9aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5', 'volume_size': 1} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:44 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6" returned: 0 in 0.849s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.517s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1815078304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a300ecd3-055b-4c2e-99de-412eb77c4bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:39Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Creating volume a300ecd3-055b-4c2e-99de-412eb77c4bbc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:44 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:44 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc 1073741824 Jul 08 01:31:44 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bef084b-fc60-4f20-93cc-88fa6e901520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3235cdeb-2268-4716-8a3e-b43985cf99d6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00ade18-e07f-4105-b971-abd138a8cccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 (3235cdeb-2268-4716-8a3e-b43985cf99d6): created successfully Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00ade18-e07f-4105-b971-abd138a8cccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (77a97125-14c7-4053-bbba-0a8c6829f031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c866d9db-d6d4-4067-b67d-cf46eaa71e6c tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created volume successfully. Jul 08 01:31:45 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc 1073741824" returned: 0 in 0.932s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:45 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc Jul 08 01:31:45 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:46 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc" returned: 0 in 0.736s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.756s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813857917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4803e7c-24c7-4972-ade3-ec93368266a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:40Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Creating volume a4803e7c-24c7-4972-ade3-ec93368266a6 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:46 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:46 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6 1073741824 Jul 08 01:31:46 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d27cf-bf65-4051-b759-c06f7ede2b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30093806-2ded-4def-8b23-e4cb513eb94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc (a300ecd3-055b-4c2e-99de-412eb77c4bbc): created successfully Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30093806-2ded-4def-8b23-e4cb513eb94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (1cb30d8d-46dc-4d7a-be70-1efd1ab6d554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c6ff2774-5d14-4e37-8e7d-74d621209b7d tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created volume successfully. Jul 08 01:31:47 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6 1073741824" returned: 0 in 0.950s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:47 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6 Jul 08 01:31:47 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:48 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.977s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-417741561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eda4bc1-7dbe-472b-be89-f1cf0ad15d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:40Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Creating volume 3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:48 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:48 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 1073741824 Jul 08 01:31:48 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778334d4-319e-412b-b740-d33648927b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4803e7c-24c7-4972-ade3-ec93368266a6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5299143-8e47-4879-b70e-04e09b84d571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume volume-a4803e7c-24c7-4972-ade3-ec93368266a6 (a4803e7c-24c7-4972-ade3-ec93368266a6): created successfully Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5299143-8e47-4879-b70e-04e09b84d571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (cb33163f-b99f-4042-b533-c42d79495491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-44dff164-38e7-4729-bf75-39fb8a6df282 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created volume successfully. Jul 08 01:31:49 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 1073741824" returned: 0 in 0.939s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:49 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 Jul 08 01:31:49 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:50 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.261s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506232209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e226bcc1-df02-4c5c-8744-3078fce21353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ebfd3290e04633b72be2e3c751d778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:41Z,use_quota=True,user_id='c820c2e887224e5896d7a8c3c8e095c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Creating volume e226bcc1-df02-4c5c-8744-3078fce21353 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:50 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353 1073741824 Jul 08 01:31:50 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269799c0-36c7-4de2-830b-7602e9b6a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6380148-9118-4fa2-9c3e-ab0d875fdd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 (3eda4bc1-7dbe-472b-be89-f1cf0ad15d12): created successfully Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6380148-9118-4fa2-9c3e-ab0d875fdd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (918ed6da-6eec-429a-a40c-b27cbb716280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5d1ef832-9ac3-4911-807d-18ac4b74b3a6 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created volume successfully. Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Flow 'volume_create_manager' (73eb37d2-c03d-4a77-954e-eaf81f865865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7827696-d241-4f7f-8f35-b3ce6031323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7827696-d241-4f7f-8f35-b3ce6031323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1093037459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0af37c9-b430-45ec-ab93-f47490a555dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca1885e233490695f95ecbfeb410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:50Z,use_quota=True,user_id='5d3e7ce8f8ae404893193302ea6097ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa44f585-94b3-48d0-bb28-2de137cbfdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa44f585-94b3-48d0-bb28-2de137cbfdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4127bf74-9d83-49fd-abdb-27275f81eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4127bf74-9d83-49fd-abdb-27275f81eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0af37c9-b430-45ec-ab93-f47490a555dc', 'volume_name': 'volume-d0af37c9-b430-45ec-ab93-f47490a555dc', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d3651-7ab9-450a-83ec-c6732614d13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d3651-7ab9-450a-83ec-c6732614d13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4fc8bb-114d-41a9-85ec-235bb8d63c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Volume d0af37c9-b430-45ec-ab93-f47490a555dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0af37c9-b430-45ec-ab93-f47490a555dc', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Trying to clone d0af37c9-b430-45ec-ab93-f47490a555dc from image 32b92798-e800-4287-a1ac-3d0d0779a37d at location (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:31:50 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353 1073741824" returned: 0 in 0.922s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=128,cinder:SELECT=95,cinder:DELETE=12,cinder:INSERT=27 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:50 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=112,cinder:UPDATE=107,cinder:INSERT=22,cinder:DELETE=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:31:51 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27ebbd0-7a25-4ad8-93c1-542a90559e7c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:51 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353 Jul 08 01:31:51 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:51 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD Jul 08 01:31:51 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:51 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353" returned: 0 in 0.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.622s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304648526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49959ea8-0261-407a-b16c-cd7abfcf9aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:44Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Creating volume 49959ea8-0261-407a-b16c-cd7abfcf9aa5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:51 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ae12f1-6069-428b-bace-ec6b9ce455c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e226bcc1-df02-4c5c-8744-3078fce21353', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:51 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 1073741824 Jul 08 01:31:51 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafafe38-a0d8-4393-a6b7-654ac7aa19df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Volume volume-e226bcc1-df02-4c5c-8744-3078fce21353 (e226bcc1-df02-4c5c-8744-3078fce21353): created successfully Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafafe38-a0d8-4393-a6b7-654ac7aa19df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Flow 'volume_create_manager' (7a44e901-6477-498b-a8af-41f6f230e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5209a309-e392-42ca-8d69-174536067838 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created volume successfully. Jul 08 01:31:51 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Temporary image 32b92798-e800-4287-a1ac-3d0d0779a37d is fetched for user 5d3e7ce8f8ae404893193302ea6097ff. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d89751-56ea-43c3-8356-218f9a28b37c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:52 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD Jul 08 01:31:52 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-e226bcc1-df02-4c5c-8744-3078fce21353-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-e226bcc1-df02-4c5c-8744-3078fce21353-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-quobyte-e226bcc1-df02-4c5c-8744-3078fce21353" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-e226bcc1-df02-4c5c-8744-3078fce21353" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:52 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f5f728-18d6-4344-a391-5856b1f7d156]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:52 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 1073741824" returned: 0 in 1.100s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:52 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 Jul 08 01:31:52 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:53 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353 Jul 08 01:31:53 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:53 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:53 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:53 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5" returned: 0 in 0.725s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.032s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Creating offline snapshot 4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a7a298-476d-4a1f-90b2-f1ad47346d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d1cf32-81fe-482a-a246-d5cbf1672296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03053e0-6184-496b-a9cd-36e1ee44737a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:53 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353" returned: 0 in 0.914s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Volume volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 (49959ea8-0261-407a-b16c-cd7abfcf9aa5): created successfully Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d1cf32-81fe-482a-a246-d5cbf1672296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (dabe6d46-28a3-4589-a4cc-f03c2ad32f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:53 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353 Jul 08 01:31:53 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0effc9d8-3dc2-4a80-a4e4-f346c80e35ff tempest-VolumesActionsTest-1959802335 None] Created volume successfully. Jul 08 01:31:53 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:31:53 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:54 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.696s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:31:54 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e226bcc1-df02-4c5c-8744-3078fce21353" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-e226bcc1-df02-4c5c-8744-3078fce21353" released by "delete_volume" :: held 1.750s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created reservations ['bfee1cfd-680f-411b-8fe6-e5a95e9b1635', 'db63b50a-4435-4616-afd9-032281a5d377', 'c4e8babe-b8b2-4de1-a066-8fcc45d71bfd', '4940b2e3-5464-459c-9b87-c21d9d3a25fc'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:54 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:54 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 1G Jul 08 01:31:54 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:54 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:54 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Acquiring lock "cinder-49959ea8-0261-407a-b16c-cd7abfcf9aa5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Lock "cinder-49959ea8-0261-407a-b16c-cd7abfcf9aa5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Acquiring lock "cinder-quobyte-49959ea8-0261-407a-b16c-cd7abfcf9aa5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Lock "cinder-quobyte-49959ea8-0261-407a-b16c-cd7abfcf9aa5" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f1108b-908c-44ee-a79b-bbbf62b0096b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-quobyte-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:55 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 Jul 08 01:31:55 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1029acb9-2b5a-4dd4-9726-5e25a51a0b3c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:55 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 Jul 08 01:31:55 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:55 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.960s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Deleted volume successfully. Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b6a6c2d-6d1f-4228-b8eb-842c3e3ceed4 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-e226bcc1-df02-4c5c-8744-3078fce21353-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:55 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 1G" returned: 0 in 1.189s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:55 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 Jul 08 01:31:55 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:56 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5" returned: 0 in 1.019s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:56 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5 Jul 08 01:31:56 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:56 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12" returned: 0 in 0.979s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:56 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12 Jul 08 01:31:56 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:56 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0" returned: 0 in 0.836s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:56 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 is being set with open permissions: ugo+rw Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:56 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-49959ea8-0261-407a-b16c-cd7abfcf9aa5" returned: 0 in 0.722s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:56 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 Jul 08 01:31:56 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Lock "cinder-quobyte-49959ea8-0261-407a-b16c-cd7abfcf9aa5" released by "delete_volume" :: held 1.854s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Created reservations ['4d830bf1-2835-4fe2-8b3c-a1384ec842dd', 'e64a1b01-ddb1-4a83-8470-09263eeeda83', 'b6d598e7-f134-4529-ad76-f1ad539ad92d', 'ac155fe4-fe7a-4960-a7ac-f4d34295866b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:56 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:56 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:57 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12" released by "delete_volume" :: held 1.779s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created reservations ['ce2eb148-3289-40f2-a4a3-bc03cdd841fe', 'e325f65f-80f6-4bcd-9c37-505cca6d782f', 'a923b345-fef9-43d3-8dc0-b74beaf1599f', 'b05df8a4-82a7-4c64-b6a9-9ad4bbc8b388'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:57 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:57 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-a4803e7c-24c7-4972-ade3-ec93368266a6-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-a4803e7c-24c7-4972-ade3-ec93368266a6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-quobyte-a4803e7c-24c7-4972-ade3-ec93368266a6" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-a4803e7c-24c7-4972-ade3-ec93368266a6" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4111c080-208b-420b-aff6-4fc2c05a87b7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:57 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0" returned: 0 in 1.115s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:57 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:57 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6 Jul 08 01:31:57 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.252s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.063s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1093037459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0af37c9-b430-45ec-ab93-f47490a555dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca1885e233490695f95ecbfeb410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:50Z,use_quota=True,user_id='5d3e7ce8f8ae404893193302ea6097ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Creating volume d0af37c9-b430-45ec-ab93-f47490a555dc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:57 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.037s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:57 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Deleted volume successfully. Jul 08 01:31:58 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc 1073741824 Jul 08 01:31:58 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4e21fd05-aa9c-4d00-a1ed-97e2d9c29b73 tempest-SnapshotsActionsTest-467489153 None] Create snapshot completed successfully Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc1ebb73-30df-4b9b-bfdb-48eb5f5d4f6f tempest-VolumesActionsTest-416766462 None] Lock "cinder-49959ea8-0261-407a-b16c-cd7abfcf9aa5-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:58 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.898s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Deleted volume successfully. Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25f75e9d-2816-414c-85d6-a06a307a78b1 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-3eda4bc1-7dbe-472b-be89-f1cf0ad15d12-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (ed1449f5-c95a-4174-9776-68ae8a11debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f7d6f7-28ba-439b-8625-acb55e17d724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f7d6f7-28ba-439b-8625-acb55e17d724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2053255599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07d4d65-1dad-4426-a8a5-4343857ab0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:58Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2ee763-db80-4f09-bd36-a9cfa648fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2ee763-db80-4f09-bd36-a9cfa648fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0a426a-0079-4c6c-9a94-98472b7fe302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0a426a-0079-4c6c-9a94-98472b7fe302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd07d4d65-1dad-4426-a8a5-4343857ab0bd', 'volume_name': 'volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7d5f5c-6092-49d0-a1be-85268d2ebe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7d5f5c-6092-49d0-a1be-85268d2ebe99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255673a8-6a44-4a27-ae3f-d4bab278bcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Volume d07d4d65-1dad-4426-a8a5-4343857ab0bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd', 'volume_size': 1} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-4ad1e6e6-585e-439d-a4f1-c1a602fa17d0-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-4ad1e6e6-585e-439d-a4f1-c1a602fa17d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-quobyte-4ad1e6e6-585e-439d-a4f1-c1a602fa17d0" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-4ad1e6e6-585e-439d-a4f1-c1a602fa17d0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Deleting offline snapshot 4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] snapshot_file for this snap is: volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a999cc95-7bb7-4799-b23b-525073fb0d5f]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:58 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 Jul 08 01:31:58 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:58 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6" returned: 0 in 1.136s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:58 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6 Jul 08 01:31:58 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:58 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc 1073741824" returned: 0 in 1.023s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:59 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc Jul 08 01:31:59 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:59 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0" returned: 0 in 0.867s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8c171d-c573-4ad9-85cc-d533d5acee46]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:59 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a4803e7c-24c7-4972-ade3-ec93368266a6" returned: 0 in 0.672s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-a4803e7c-24c7-4972-ade3-ec93368266a6" released by "delete_volume" :: held 1.875s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:59 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:31:59 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created reservations ['54342fe5-d4fa-425e-a1e4-5ffca6ea6790', '957fde10-8208-4c9f-960f-1dc50774f187', 'a2acd77a-b67e-430b-a054-46c7aeaf8382', '1eed159e-f076-4c51-97ba-a9f46e9b0f8a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:59 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:31:59 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:59 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-a300ecd3-055b-4c2e-99de-412eb77c4bbc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc" returned: 0 in 0.766s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2053255599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07d4d65-1dad-4426-a8a5-4343857ab0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:58Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Creating volume d07d4d65-1dad-4426-a8a5-4343857ab0bd {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-a300ecd3-055b-4c2e-99de-412eb77c4bbc-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Attempting download of 32b92798-e800-4287-a1ac-3d0d0779a37d ((None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}])) to volume d0af37c9-b430-45ec-ab93-f47490a555dc. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:31:59 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd 1073741824 Jul 08 01:31:59 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-quobyte-a300ecd3-055b-4c2e-99de-412eb77c4bbc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-a300ecd3-055b-4c2e-99de-412eb77c4bbc" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a76c09-806f-4ee4-9bf1-5ac034d27a89]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_g9lqcdk4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8db4b2-db9e-4233-a970-4f458ffa0f03]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:00 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_g9lqcdk4 Jul 08 01:32:00 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:00 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc Jul 08 01:32:00 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:00 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 1.058s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:00 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 Jul 08 01:32:00 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:00 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.942s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Deleted volume successfully. Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-136582a7-f052-4840-a86f-415455f15f5a tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-a4803e7c-24c7-4972-ade3-ec93368266a6-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:00 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_g9lqcdk4" returned: 0 in 0.856s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_g9lqcdk4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:01 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_g9lqcdk4 Jul 08 01:32:01 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:01 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd 1073741824" returned: 0 in 1.391s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:01 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc" returned: 0 in 1.201s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:01 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc Jul 08 01:32:01 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:01 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd Jul 08 01:32:01 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:01 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0" returned: 0 in 1.033s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:01 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0 Jul 08 01:32:01 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:01 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_g9lqcdk4" returned: 1 in 0.898s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_g9lqcdk4' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[541271d5-bbc2-4673-bf3a-42ff46908705]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:01 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD Jul 08 01:32:01 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:01 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a300ecd3-055b-4c2e-99de-412eb77c4bbc" returned: 0 in 0.726s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-a300ecd3-055b-4c2e-99de-412eb77c4bbc" released by "delete_volume" :: held 2.025s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created reservations ['b6679102-0e66-44cf-b6aa-cd05ae72f4fb', 'ffb0867d-7878-4b03-afa4-b1d02fb2509e', '8c199e5b-609e-47ce-b3e1-07ddd84ce59f', 'c8827165-a3ef-43cf-8052-b79dee159325'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:02 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd" returned: 0 in 0.924s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] <== create_volume: return (2381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.384s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:02 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:02 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255673a8-6a44-4a27-ae3f-d4bab278bcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8303a5c6-cbcc-4b00-ab6f-45386cee36d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Volume volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd (d07d4d65-1dad-4426-a8a5-4343857ab0bd): created successfully Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8303a5c6-cbcc-4b00-ab6f-45386cee36d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (ed1449f5-c95a-4174-9776-68ae8a11debc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:02 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.4ad1e6e6-585e-439d-a4f1-c1a602fa17d0" returned: 0 in 0.840s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9143db1c-c6af-4f3a-884a-41260c25b6d6 tempest-VolumesActionsTest-1959802335 None] Created volume successfully. Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-4ad1e6e6-585e-439d-a4f1-c1a602fa17d0" released by "_delete_snapshot" :: held 3.917s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" released by "delete_snapshot" :: held 3.949s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Created reservations ['72529daf-cb39-46b2-b881-d5ec1a05d92c', '8ae31614-b7fa-4cb4-ac61-c03461957822', 'dc16bb3b-c96b-4287-9c1c-2650870ddd9d', 'fc3c8601-ee4c-4fb5-a463-71ecb50a0ae4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Delete snapshot completed successfully. Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4046da6e-2244-4731-980e-64eb8d5ac5ec tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-4ad1e6e6-585e-439d-a4f1-c1a602fa17d0-delete_snapshot" released by "delete_snapshot" :: held 4.113s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:02 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD" returned: 0 in 0.953s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] 32b92798-e800-4287-a1ac-3d0d0779a37d was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:02 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc Jul 08 01:32:02 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:03 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.844s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Deleted volume successfully. Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ca2fd258-322b-4e5f-801d-e1ba3b6f2312 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-a300ecd3-055b-4c2e-99de-412eb77c4bbc-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Creating offline snapshot 2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ef01c0-aab0-4114-83d9-bdce32f3a469]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-3235cdeb-2268-4716-8a3e-b43985cf99d6-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-3235cdeb-2268-4716-8a3e-b43985cf99d6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:03 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:32:03 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-quobyte-3235cdeb-2268-4716-8a3e-b43985cf99d6" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-3235cdeb-2268-4716-8a3e-b43985cf99d6" acquired by "delete_volume" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dd343d-0d8f-4d6b-8091-c89dc4bb2f7f]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:03 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 Jul 08 01:32:03 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Acquiring lock "cinder-d07d4d65-1dad-4426-a8a5-4343857ab0bd-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Lock "cinder-d07d4d65-1dad-4426-a8a5-4343857ab0bd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Acquiring lock "cinder-quobyte-d07d4d65-1dad-4426-a8a5-4343857ab0bd" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Lock "cinder-quobyte-d07d4d65-1dad-4426-a8a5-4343857ab0bd" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[54688151-0049-4965-aa35-76a799add5f2]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:04 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd Jul 08 01:32:04 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:04 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 1.154s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:04 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 1G Jul 08 01:32:04 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:04 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6" returned: 0 in 1.172s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:04 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6 Jul 08 01:32:04 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:04 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd" returned: 0 in 0.980s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:04 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd Jul 08 01:32:04 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:05 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc" returned: 0 in 2.543s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_eiwlpf1ydevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:32:05 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Converted 112.00 MB image at 44.02 MB/s Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:05 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc 1G Jul 08 01:32:05 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:05 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 1G" returned: 0 in 1.089s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:05 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:05 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 Jul 08 01:32:05 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3235cdeb-2268-4716-8a3e-b43985cf99d6" returned: 0 in 0.798s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-3235cdeb-2268-4716-8a3e-b43985cf99d6" released by "delete_volume" :: held 2.035s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created reservations ['85efbfbf-1caa-4212-adf2-ef7bce6717e4', '389cd33c-6ece-4339-926e-9730a6a8ddac', '1fffe033-11c2-4060-8514-99c8a9d210eb', 'f17fae50-90ff-49b2-972a-44f41e097946'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:05 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d07d4d65-1dad-4426-a8a5-4343857ab0bd" returned: 0 in 0.880s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:05 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:05 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Lock "cinder-quobyte-d07d4d65-1dad-4426-a8a5-4343857ab0bd" released by "delete_volume" :: held 1.918s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Created reservations ['dc4ef504-72f6-48be-b7aa-f045b2ded3c9', '98f5e0aa-ab72-4f6a-b737-681660396c91', '8154f42c-4185-4c2a-8cd0-cca69e0e56ce', 'd9eff10b-e932-41bc-afd9-f2a988e84c4a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:05 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:05 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:06 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc 1G" returned: 0 in 0.961s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b23d19c-8e8c-463b-b979-cc2f6031f96d]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:06 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc Jul 08 01:32:06 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:06 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5" returned: 0 in 1.078s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:06 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 is being set with open permissions: ugo+rw Jul 08 01:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:06 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 Jul 08 01:32:06 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:06 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.019s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:06 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Deleted volume successfully. Jul 08 01:32:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54eac0fd-006c-4797-a94e-ca69271b5574 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-3235cdeb-2268-4716-8a3e-b43985cf99d6-delete_volume" released by "delete_volume" :: held 3.453s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-006c5878-8d45-423d-96b1-381170a81f66-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-006c5878-8d45-423d-96b1-381170a81f66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-quobyte-94a71674-178e-423f-8c37-5749042e6a79" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-94a71674-178e-423f-8c37-5749042e6a79" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-quobyte-006c5878-8d45-423d-96b1-381170a81f66" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-006c5878-8d45-423d-96b1-381170a81f66" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Deleting offline snapshot 006c5878-8d45-423d-96b1-381170a81f66 of volume 94a71674-178e-423f-8c37-5749042e6a79 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] snapshot_file for this snap is: volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff9fba-2305-433a-9f54-f12800d761a7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:07 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (bcd943bf-b7d3-4188-a58f-fff50a76e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb019a5-fcfa-4394-a7e6-587a1d0e6437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:07 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 Jul 08 01:32:07 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.449s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb019a5-fcfa-4394-a7e6-587a1d0e6437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-756108019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14b9ec1-ee08-4348-b4d1-54996a251a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:07Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d3641a-5c71-441d-9dcb-e891c43bd04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d3641a-5c71-441d-9dcb-e891c43bd04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef7f3b6-4329-4c21-a1db-7c606543e1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef7f3b6-4329-4c21-a1db-7c606543e1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14b9ec1-ee08-4348-b4d1-54996a251a99', 'volume_name': 'volume-a14b9ec1-ee08-4348-b4d1-54996a251a99', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc4f349-7022-4af9-b09a-9cdcd8323504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc4f349-7022-4af9-b09a-9cdcd8323504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d565a3d8-f9af-48e9-acf4-07f046189138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Volume a14b9ec1-ee08-4348-b4d1-54996a251a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14b9ec1-ee08-4348-b4d1-54996a251a99', 'volume_size': 1} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Deleted volume successfully. Jul 08 01:32:07 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5" returned: 0 in 0.997s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.449s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d1ac2e82-9cfd-407c-b740-553d3d563767 tempest-VolumesActionsTest-416766462 None] Lock "cinder-d07d4d65-1dad-4426-a8a5-4343857ab0bd-delete_volume" released by "delete_volume" :: held 3.792s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.080s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-756108019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14b9ec1-ee08-4348-b4d1-54996a251a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:07Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Creating volume a14b9ec1-ee08-4348-b4d1-54996a251a99 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:07 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:07 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 1073741824 Jul 08 01:32:07 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-05a75ef3-350f-46f4-87a4-144951f012d0 tempest-SnapshotsActionsTest-467489153 None] Create snapshot completed successfully Jul 08 01:32:07 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc" returned: 0 in 1.363s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:07 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc Jul 08 01:32:07 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:08 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94a71674-178e-423f-8c37-5749042e6a79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1f4c0b-3115-4cf9-8c2e-90b888394b0e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:08 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 Jul 08 01:32:08 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-2f9b6bd0-4363-4dd7-b0df-66c4214a10b5-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-2f9b6bd0-4363-4dd7-b0df-66c4214a10b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:08 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 1073741824" returned: 0 in 1.060s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-quobyte-2f9b6bd0-4363-4dd7-b0df-66c4214a10b5" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:08 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc" returned: 1 in 0.964s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Downloaded image 32b92798-e800-4287-a1ac-3d0d0779a37d ((None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}])) to volume d0af37c9-b430-45ec-ab93-f47490a555dc successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Temporary image 32b92798-e800-4287-a1ac-3d0d0779a37d for user 5d3e7ce8f8ae404893193302ea6097ff is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Marking volume d0af37c9-b430-45ec-ab93-f47490a555dc as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-2f9b6bd0-4363-4dd7-b0df-66c4214a10b5" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Deleting offline snapshot 2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] snapshot_file for this snap is: volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Copying metadata from image 32b92798-e800-4287-a1ac-3d0d0779a37d to d0af37c9-b430-45ec-ab93-f47490a555dc. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Creating volume glance metadata for volume d0af37c9-b430-45ec-ab93-f47490a555dc backed by image 32b92798-e800-4287-a1ac-3d0d0779a37d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e95e80a-668a-4a2d-ad96-784a60250fc8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:08 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 Jul 08 01:32:08 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4fc8bb-114d-41a9-85ec-235bb8d63c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0af37c9-b430-45ec-ab93-f47490a555dc', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044739e5-576c-4231-b35e-879d52ae99b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:08 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 Jul 08 01:32:08 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Volume volume-d0af37c9-b430-45ec-ab93-f47490a555dc (d0af37c9-b430-45ec-ab93-f47490a555dc): created successfully Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044739e5-576c-4231-b35e-879d52ae99b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Flow 'volume_create_manager' (73eb37d2-c03d-4a77-954e-eaf81f865865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-abc4824a-cdb9-480f-8b9d-6536561b7366 tempest-VolumesImageMetadata-1099784091 None] Created volume successfully. Jul 08 01:32:09 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79" returned: 0 in 1.008s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:09 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 Jul 08 01:32:09 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Acquiring lock "cinder-d0af37c9-b430-45ec-ab93-f47490a555dc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Lock "cinder-d0af37c9-b430-45ec-ab93-f47490a555dc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Acquiring lock "cinder-quobyte-d0af37c9-b430-45ec-ab93-f47490a555dc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Lock "cinder-quobyte-d0af37c9-b430-45ec-ab93-f47490a555dc" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:09 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99" returned: 0 in 0.892s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d565a3d8-f9af-48e9-acf4-07f046189138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14b9ec1-ee08-4348-b4d1-54996a251a99', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacd28fa-f16d-4e11-bf8b-d8c588431397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc86cb4-1246-47ea-bf4a-7029e5eda30f]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Volume volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 (a14b9ec1-ee08-4348-b4d1-54996a251a99): created successfully Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacd28fa-f16d-4e11-bf8b-d8c588431397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (bcd943bf-b7d3-4188-a58f-fff50a76e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cea0a5eb-c14d-4e1d-8de1-31d808348fc7 tempest-VolumesActionsTest-1959802335 None] Created volume successfully. Jul 08 01:32:09 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5" returned: 0 in 1.059s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:09 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc Jul 08 01:32:09 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b781f5-fc3d-4b4d-84ee-93362993cecd]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:09 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:32:09 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:10 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66" returned: 0 in 0.907s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:10 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66 Jul 08 01:32:10 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:10 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc" returned: 0 in 0.863s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:10 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 0.840s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:10 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc Jul 08 01:32:10 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:10 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 Jul 08 01:32:10 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:10 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79.006c5878-8d45-423d-96b1-381170a81f66" returned: 0 in 0.737s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Acquiring lock "cinder-a14b9ec1-ee08-4348-b4d1-54996a251a99-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-006c5878-8d45-423d-96b1-381170a81f66" released by "_delete_snapshot" :: held 3.796s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Lock "cinder-a14b9ec1-ee08-4348-b4d1-54996a251a99-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-94a71674-178e-423f-8c37-5749042e6a79" released by "delete_snapshot" :: held 3.847s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Acquiring lock "cinder-quobyte-a14b9ec1-ee08-4348-b4d1-54996a251a99" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Lock "cinder-quobyte-a14b9ec1-ee08-4348-b4d1-54996a251a99" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:10 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created reservations ['b042670e-44e5-4699-a6e8-7dcbd311feeb', '435df641-25cd-4e95-94f6-d07d1a3ed570', '2b1ae7f3-3004-4910-adf2-b7d39993fb01', '37288d69-fb02-46ff-bcc6-3120c4622db7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba093c43-eba7-4f5a-96dc-7447a795d687]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Delete snapshot completed successfully. Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7a10656c-337b-44e2-a914-7d1fa5bf4930 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-006c5878-8d45-423d-96b1-381170a81f66-delete_snapshot" released by "delete_snapshot" :: held 4.117s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:11 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 Jul 08 01:32:11 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-94a71674-178e-423f-8c37-5749042e6a79-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-94a71674-178e-423f-8c37-5749042e6a79-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "cinder-quobyte-94a71674-178e-423f-8c37-5749042e6a79" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-94a71674-178e-423f-8c37-5749042e6a79" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:11 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc" returned: 1 in 0.955s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7a17ec-8ad2-46a7-9351-034424562fba]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:11 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc Jul 08 01:32:11 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:11 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 Jul 08 01:32:11 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:11 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5" returned: 0 in 1.049s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:11 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5 Jul 08 01:32:11 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:12 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99" returned: 0 in 1.040s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:12 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99 Jul 08 01:32:12 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:12 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d0af37c9-b430-45ec-ab93-f47490a555dc" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Lock "cinder-quobyte-d0af37c9-b430-45ec-ab93-f47490a555dc" released by "delete_volume" :: held 2.680s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Created reservations ['b78f4e23-4610-4de2-9fcf-d32ed0850fc4', 'a8efaec7-f746-4734-8c70-26b423890839', '4065374b-dd48-4133-8af1-5541190a29ff', '255809f5-b4ec-4083-9ad0-2fb9dab6281a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:12 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:12 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:12 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79" returned: 0 in 1.062s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:12 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.2f9b6bd0-4363-4dd7-b0df-66c4214a10b5" returned: 0 in 0.891s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:12 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79 Jul 08 01:32:12 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-2f9b6bd0-4363-4dd7-b0df-66c4214a10b5" released by "_delete_snapshot" :: held 3.956s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" released by "delete_snapshot" :: held 3.998s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Created reservations ['326bce65-b66d-465a-9902-4522b147ffa3', '3824a22f-834d-4e6e-bc29-6c9370b1ce30', '36444a2a-ce2f-466e-8156-81eefe3be2ef', 'f13c383a-6dbf-4b6e-9617-b262dc458399'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Delete snapshot completed successfully. Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2585aeca-2688-42e0-8394-8efb7ba266d6 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-2f9b6bd0-4363-4dd7-b0df-66c4214a10b5-delete_snapshot" released by "delete_snapshot" :: held 4.215s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:12 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a14b9ec1-ee08-4348-b4d1-54996a251a99" returned: 0 in 0.850s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Lock "cinder-quobyte-a14b9ec1-ee08-4348-b4d1-54996a251a99" released by "delete_volume" :: held 1.953s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Created reservations ['f8e9982c-176a-45f9-afed-e7690c3a5f58', '76090af6-656c-4e02-92ec-e02659d00876', '714000d8-913f-46d6-a296-5c0f5ce40fd3', '19182e75-77c1-4482-be5f-1c90b590aede'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:13 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:13 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:13 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.021s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Deleted volume successfully. Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Creating offline snapshot aef76ee2-87d9-4521-81c6-a6fd990a844a of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:32:13 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94a71674-178e-423f-8c37-5749042e6a79" returned: 0 in 1.032s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c388672d-1fae-4b26-b8c7-e1492d8956a0]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-quobyte-94a71674-178e-423f-8c37-5749042e6a79" released by "delete_volume" :: held 2.201s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fc05126c-9dff-42ff-9e07-3bd1e5891bfa tempest-VolumesImageMetadata-1099784091 None] Lock "cinder-d0af37c9-b430-45ec-ab93-f47490a555dc-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Created reservations ['4c68aacf-4581-4a4b-a33b-bc2722a6f189', '01484ada-2248-4a5d-8cf6-4daddcde9a8b', '45550180-a753-4496-b4bd-9cee389f053b', '93714347-8dff-448b-838b-19d1e22b64dd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:13 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:32:13 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:13 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:13 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (f6b5b04f-e639-4ed1-8736-e1772e1af744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bfe927-e701-4ba3-ab95-d6280ab2383d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bfe927-e701-4ba3-ab95-d6280ab2383d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-30305295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd03144-d078-4bec-804e-0f40c0adbc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:14Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d61de47-bec3-446f-83aa-5888fe509110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d61de47-bec3-446f-83aa-5888fe509110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0134cb-1487-4a74-9f01-57f810987e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0134cb-1487-4a74-9f01-57f810987e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd03144-d078-4bec-804e-0f40c0adbc2d', 'volume_name': 'volume-afd03144-d078-4bec-804e-0f40c0adbc2d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b98038e-bfa3-401f-b42f-b99bde77ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b98038e-bfa3-401f-b42f-b99bde77ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbd9809-13b0-4ac5-a9f7-f6c20d0047ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:14 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Volume afd03144-d078-4bec-804e-0f40c0adbc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd03144-d078-4bec-804e-0f40c0adbc2d', 'volume_size': 1} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:14 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.119s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Deleted volume successfully. Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a7459a-631f-4d03-9d3d-4ac9f0f3ff2d tempest-VolumesActionsTest-416766462 None] Lock "cinder-a14b9ec1-ee08-4348-b4d1-54996a251a99-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:14 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 1.080s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:14 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Deleted volume successfully. Jul 08 01:32:14 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a 1G Jul 08 01:32:14 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64d83a14-1fc2-4ba2-b63d-e6f9adf81894 tempest-CreateVolumesFromSnapshotTest-2132190648 None] Lock "cinder-94a71674-178e-423f-8c37-5749042e6a79-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:15 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a 1G" returned: 0 in 1.138s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:15 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a Jul 08 01:32:15 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:16 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a" returned: 0 in 0.858s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:16 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a is being set with open permissions: ugo+rw Jul 08 01:32:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:16 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a Jul 08 01:32:16 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Flow 'volume_create_manager' (9884de99-b524-44f2-9c31-0f4c76246da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6daba401-0269-45ff-88fe-a82704c72f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6daba401-0269-45ff-88fe-a82704c72f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1828168602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63febe17-b2d7-41b3-ada8-1b00440a6ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5d2fcd2756467d94a573b4997ed6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:17Z,use_quota=True,user_id='32026f3797ae45129f81b1825387149a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b1c3f8-1ac8-4722-85e8-73d21db0d996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b1c3f8-1ac8-4722-85e8-73d21db0d996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b9329a-5a85-40de-a385-e531dcab95eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b9329a-5a85-40de-a385-e531dcab95eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63febe17-b2d7-41b3-ada8-1b00440a6ab7', 'volume_name': 'volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defd363b-4076-43aa-95fc-bc7c4f81057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defd363b-4076-43aa-95fc-bc7c4f81057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c353b6f5-42e9-4a6a-8944-088103d4e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Volume 63febe17-b2d7-41b3-ada8-1b00440a6ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7', 'volume_size': 1} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:17 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a" returned: 0 in 0.804s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.041s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.290s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-30305295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd03144-d078-4bec-804e-0f40c0adbc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:14Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Creating volume afd03144-d078-4bec-804e-0f40c0adbc2d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:17 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:32:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:17 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d 1073741824 Jul 08 01:32:17 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7215cccb-c5f7-4cb5-9153-596b266742a8 tempest-SnapshotsActionsTest-467489153 None] Create snapshot completed successfully Jul 08 01:32:18 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d 1073741824" returned: 0 in 0.899s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:18 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d Jul 08 01:32:18 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-aef76ee2-87d9-4521-81c6-a6fd990a844a-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-aef76ee2-87d9-4521-81c6-a6fd990a844a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-quobyte-aef76ee2-87d9-4521-81c6-a6fd990a844a" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-aef76ee2-87d9-4521-81c6-a6fd990a844a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Deleting offline snapshot aef76ee2-87d9-4521-81c6-a6fd990a844a of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] snapshot_file for this snap is: volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c995d423-3cde-43e9-9d2d-372d265f4456]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:19 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a Jul 08 01:32:19 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:19 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1828168602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63febe17-b2d7-41b3-ada8-1b00440a6ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5d2fcd2756467d94a573b4997ed6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:17Z,use_quota=True,user_id='32026f3797ae45129f81b1825387149a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Creating volume 63febe17-b2d7-41b3-ada8-1b00440a6ab7 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:19 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:19 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 1073741824 Jul 08 01:32:19 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbd9809-13b0-4ac5-a9f7-f6c20d0047ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd03144-d078-4bec-804e-0f40c0adbc2d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af40aa17-7d6c-41a6-b111-79912134b49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Volume volume-afd03144-d078-4bec-804e-0f40c0adbc2d (afd03144-d078-4bec-804e-0f40c0adbc2d): created successfully Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af40aa17-7d6c-41a6-b111-79912134b49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (f6b5b04f-e639-4ed1-8736-e1772e1af744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b2973aa9-a7f5-47fe-b964-660d2d399c24 tempest-VolumesActionsTest-1959802335 None] Created volume successfully. Jul 08 01:32:19 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a" returned: 0 in 0.893s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df8def-796c-4df0-95e2-7a40bcb491aa]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:19 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:32:19 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:20 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 1073741824" returned: 0 in 1.032s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:20 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 Jul 08 01:32:20 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:20 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 0.927s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Acquiring lock "cinder-afd03144-d078-4bec-804e-0f40c0adbc2d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:20 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a Jul 08 01:32:20 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Lock "cinder-afd03144-d078-4bec-804e-0f40c0adbc2d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Acquiring lock "cinder-quobyte-afd03144-d078-4bec-804e-0f40c0adbc2d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Lock "cinder-quobyte-afd03144-d078-4bec-804e-0f40c0adbc2d" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c73309-099c-4c4f-b61a-ea2ee7f8660f]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:21 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d Jul 08 01:32:21 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:21 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7" returned: 0 in 0.912s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c353b6f5-42e9-4a6a-8944-088103d4e036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3aa0e7-eec3-4072-a9b1-2ffbfc1717a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Volume volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 (63febe17-b2d7-41b3-ada8-1b00440a6ab7): created successfully Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3aa0e7-eec3-4072-a9b1-2ffbfc1717a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Flow 'volume_create_manager' (9884de99-b524-44f2-9c31-0f4c76246da7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8f022a88-ec46-4c6a-ae8f-7cbd0a365008 tempest-SnapshotMetadataTestJSON-935110408 None] Created volume successfully. Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Flow 'volume_create_manager' (337df9ac-2ff5-4db3-978c-9399a1a01ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197a0565-8cdb-4b26-9856-2855ff7f9b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197a0565-8cdb-4b26-9856-2855ff7f9b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36eb24e4-1619-4280-922e-804d4cbc19ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ebcf2529ae4a04b83e2307fb0d57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:22Z,use_quota=True,user_id='6519aefb32ab4332baa2941c9496b118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5c36af-fce8-4cd9-a43b-72d0401eafe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5c36af-fce8-4cd9-a43b-72d0401eafe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cd7d99-6403-4d06-91b1-af51021898f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:32:21 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a" returned: 0 in 0.987s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:21 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a Jul 08 01:32:21 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:21 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d" returned: 0 in 1.045s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:22 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d Jul 08 01:32:22 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cd7d99-6403-4d06-91b1-af51021898f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36eb24e4-1619-4280-922e-804d4cbc19ff', 'volume_name': 'volume-36eb24e4-1619-4280-922e-804d4cbc19ff', 'volume_size': 1, 'image_id': '4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9fac3222fff2c8976a60381fbf2fe60d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4ebcf2529ae4a04b83e2307fb0d57fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2091c1e7e620f3518e9625160770b96037bc4a8c98cec7917afbf5f9b22ae8e2708c17bd25b510c150ee8ccc2a75146a2487e4f6c0260be519705350a9906a07', 'id': '4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'created_at': datetime.datetime(2026, 7, 7, 23, 32, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 32, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07145ff3-de75-4233-85ba-e81fcb64af09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07145ff3-de75-4233-85ba-e81fcb64af09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8031d3a-a69b-46b5-985b-3f0bd14d7f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:22 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Volume 36eb24e4-1619-4280-922e-804d4cbc19ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36eb24e4-1619-4280-922e-804d4cbc19ff', 'volume_size': 1, 'image_id': '4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9fac3222fff2c8976a60381fbf2fe60d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4ebcf2529ae4a04b83e2307fb0d57fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2091c1e7e620f3518e9625160770b96037bc4a8c98cec7917afbf5f9b22ae8e2708c17bd25b510c150ee8ccc2a75146a2487e4f6c0260be519705350a9906a07', 'id': '4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'created_at': datetime.datetime(2026, 7, 7, 23, 32, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 32, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720/file', 'properties': {}}, 'image_service': } Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Trying to clone 36eb24e4-1619-4280-922e-804d4cbc19ff from image 4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:32:22 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1dfd22-59d4-43d7-a9fe-498f358d72d1]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:22 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD Jul 08 01:32:22 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:22 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.aef76ee2-87d9-4521-81c6-a6fd990a844a" returned: 0 in 0.818s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-aef76ee2-87d9-4521-81c6-a6fd990a844a" released by "_delete_snapshot" :: held 3.750s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" released by "delete_snapshot" :: held 3.780s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Created reservations ['586cebb0-102b-4761-a9dd-d79c0d92478a', '517b96ea-a801-481b-848d-dd34459bc424', 'dadde29e-b91b-4b7a-afb0-b86256b8a508', 'f9cca961-a1f7-4b57-9161-94c402b844fb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Creating offline snapshot 73f8ac8d-96b3-4dc8-85f3-d74292749f04 of volume 63febe17-b2d7-41b3-ada8-1b00440a6ab7 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd21dd4-ca3f-4163-b7c1-cadada3d715a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:22 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-afd03144-d078-4bec-804e-0f40c0adbc2d" returned: 0 in 0.881s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Delete snapshot completed successfully. Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Lock "cinder-quobyte-afd03144-d078-4bec-804e-0f40c0adbc2d" released by "delete_volume" :: held 1.988s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1c4b445-d0ff-4051-9896-93bc853e45d1 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-aef76ee2-87d9-4521-81c6-a6fd990a844a-delete_snapshot" released by "delete_snapshot" :: held 4.082s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:22 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Created reservations ['7567c7d2-63d1-4a1f-8de4-98100478c9ec', '0733b44c-38f6-40a0-a518-3f177cc92ad0', 'aff477a6-828f-49a0-a195-3513b12db9ec', 'c646ff91-6eab-4ebe-be6f-9d83b880ff60'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:22 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 Jul 08 01:32:22 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:23 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:23 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:23 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD" returned: 0 in 1.035s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:23 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD Jul 08 01:32:23 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:23 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7" returned: 0 in 0.988s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:23 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:23 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 1G Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:23 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Deleted volume successfully. Jul 08 01:32:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2d213e94-62e6-463e-874b-a4deed826e16 tempest-VolumesActionsTest-416766462 None] Lock "cinder-afd03144-d078-4bec-804e-0f40c0adbc2d-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:24 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD" returned: 1 in 0.834s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Temporary image 4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720 is fetched for user 6519aefb32ab4332baa2941c9496b118. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[538af32a-e895-441a-9346-e6bb278bf0aa]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:24 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD Jul 08 01:32:24 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:24 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 1G" returned: 0 in 0.988s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:24 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 Jul 08 01:32:24 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (3692d2e7-ef8c-4483-b530-aecdcea5748d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e438b6-7ef1-4d55-b3a4-f4fe6c8b99e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e438b6-7ef1-4d55-b3a4-f4fe6c8b99e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416668643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81caebce-e86a-44c4-82ee-2e474883c3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:25Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afac6f5-4253-465f-ba69-6f6a9871b8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afac6f5-4253-465f-ba69-6f6a9871b8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6021335a-6d79-4bdf-a909-1a1d2a982e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6021335a-6d79-4bdf-a909-1a1d2a982e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81caebce-e86a-44c4-82ee-2e474883c3f2', 'volume_name': 'volume-81caebce-e86a-44c4-82ee-2e474883c3f2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c022e81-10db-492f-a0e8-c103705bbe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c022e81-10db-492f-a0e8-c103705bbe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee16043-d40a-446c-ba19-b41c14b0ee94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Volume 81caebce-e86a-44c4-82ee-2e474883c3f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81caebce-e86a-44c4-82ee-2e474883c3f2', 'volume_size': 1} Jul 08 01:32:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:25 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:25 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD Jul 08 01:32:25 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:25 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04" returned: 0 in 0.748s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:25 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 is being set with open permissions: ugo+rw Jul 08 01:32:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:25 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 Jul 08 01:32:25 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:25 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD" returned: 1 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:32:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:26 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04" returned: 0 in 0.667s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:26 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.info Jul 08 01:32:26 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:27 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.info" returned: 0 in 0.733s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:27 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.info is being set with open permissions: ugo+rw Jul 08 01:32:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:27 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.info Jul 08 01:32:27 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:27 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.info" returned: 0 in 0.707s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.941s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.232s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Creating offline snapshot 51bc8ae7-cc26-46cf-825c-d10d5f40fbcd of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:32:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a8dc294-1061-4b23-86af-87d07b118ce1 tempest-SnapshotMetadataTestJSON-935110408 None] Create snapshot completed successfully Jul 08 01:32:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff54687-c094-4831-b2f7-645658df26f7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:27 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:32:27 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:28 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 0.860s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:28 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd 1G Jul 08 01:32:28 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Acquiring lock "cinder-73f8ac8d-96b3-4dc8-85f3-d74292749f04-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-73f8ac8d-96b3-4dc8-85f3-d74292749f04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Acquiring lock "cinder-quobyte-63febe17-b2d7-41b3-ada8-1b00440a6ab7" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-quobyte-63febe17-b2d7-41b3-ada8-1b00440a6ab7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Acquiring lock "cinder-quobyte-73f8ac8d-96b3-4dc8-85f3-d74292749f04" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-quobyte-73f8ac8d-96b3-4dc8-85f3-d74292749f04" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Deleting offline snapshot 73f8ac8d-96b3-4dc8-85f3-d74292749f04 of volume 63febe17-b2d7-41b3-ada8-1b00440a6ab7 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] snapshot_file for this snap is: volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0e85bb-7133-436d-977f-282b86ce29a8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:29 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 Jul 08 01:32:29 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:29 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd 1G" returned: 0 in 0.970s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:29 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd Jul 08 01:32:29 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:29 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04" returned: 0 in 0.839s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62a1b90-ecd5-4984-929d-8e0c882c6793]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:30 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 Jul 08 01:32:30 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:30 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:30 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd is being set with open permissions: ugo+rw Jul 08 01:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:30 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd Jul 08 01:32:30 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:30 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7" returned: 0 in 0.808s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:30 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 Jul 08 01:32:30 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:31 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd" returned: 0 in 0.668s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.373s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.171s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416668643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81caebce-e86a-44c4-82ee-2e474883c3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafaaae5f4ab4d8b9946a383aa46012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:25Z,use_quota=True,user_id='4bfe1f68ecdb4751a4cf7a381ef07790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Creating volume 81caebce-e86a-44c4-82ee-2e474883c3f2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:31 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:31 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2 1073741824 Jul 08 01:32:31 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5481b342-3d4f-4630-bc60-6674a20e0743 tempest-SnapshotsActionsTest-467489153 None] Create snapshot completed successfully Jul 08 01:32:31 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04" returned: 0 in 0.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:31 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04 Jul 08 01:32:31 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-51bc8ae7-cc26-46cf-825c-d10d5f40fbcd-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-51bc8ae7-cc26-46cf-825c-d10d5f40fbcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Acquiring lock "cinder-quobyte-51bc8ae7-cc26-46cf-825c-d10d5f40fbcd" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:32 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-51bc8ae7-cc26-46cf-825c-d10d5f40fbcd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Deleting offline snapshot 51bc8ae7-cc26-46cf-825c-d10d5f40fbcd of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] snapshot_file for this snap is: volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2 1073741824" returned: 0 in 1.023s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7485ed20-c4c7-4529-864f-074469e7bcfe]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:32 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7.73f8ac8d-96b3-4dc8-85f3-d74292749f04" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:32 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2 Jul 08 01:32:32 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-quobyte-73f8ac8d-96b3-4dc8-85f3-d74292749f04" released by "_delete_snapshot" :: held 3.272s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-quobyte-63febe17-b2d7-41b3-ada8-1b00440a6ab7" released by "delete_snapshot" :: held 3.299s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:32 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd Jul 08 01:32:32 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Created reservations ['7a4fd815-2ce3-4e9f-bb7b-f926a7e8b9e0', 'b74028b4-0ff3-4895-ad0f-c4416cb967fb', '0a7666ab-d115-4a5e-91c6-32d1842209c7', '61a625b9-9129-42c1-83ae-eb69d2d3ad38'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Delete snapshot completed successfully. Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51144be1-7fd9-4ac6-a054-a50dd2499038 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-73f8ac8d-96b3-4dc8-85f3-d74292749f04-delete_snapshot" released by "delete_snapshot" :: held 3.468s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:32 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2" returned: 0 in 0.711s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.095s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36eb24e4-1619-4280-922e-804d4cbc19ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ebcf2529ae4a04b83e2307fb0d57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:22Z,use_quota=True,user_id='6519aefb32ab4332baa2941c9496b118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Creating volume 36eb24e4-1619-4280-922e-804d4cbc19ff {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:32 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee16043-d40a-446c-ba19-b41c14b0ee94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81caebce-e86a-44c4-82ee-2e474883c3f2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:32 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff 1073741824 Jul 08 01:32:33 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5988326-3d2d-4f27-a191-1cbaa6277c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:33 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Volume volume-81caebce-e86a-44c4-82ee-2e474883c3f2 (81caebce-e86a-44c4-82ee-2e474883c3f2): created successfully Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5988326-3d2d-4f27-a191-1cbaa6277c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Flow 'volume_create_manager' (3692d2e7-ef8c-4483-b530-aecdcea5748d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3232191b-26e3-4b0c-9c0b-927a6e5a3c06 tempest-VolumesActionsTest-1959802335 None] Created volume successfully. Jul 08 01:32:33 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd" returned: 0 in 0.896s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffce62f-9092-4976-82d3-3bb0143fe365]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:33 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:32:33 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Acquiring lock "cinder-63febe17-b2d7-41b3-ada8-1b00440a6ab7-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-63febe17-b2d7-41b3-ada8-1b00440a6ab7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Acquiring lock "cinder-quobyte-63febe17-b2d7-41b3-ada8-1b00440a6ab7" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-quobyte-63febe17-b2d7-41b3-ada8-1b00440a6ab7" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f099f8-6a9f-4c50-8f98-e9dbb3dfd5f8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:33 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 Jul 08 01:32:33 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:33 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff 1073741824" returned: 0 in 1.019s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:34 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff Jul 08 01:32:34 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:34 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 0.950s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:34 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd Jul 08 01:32:34 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Acquiring lock "cinder-81caebce-e86a-44c4-82ee-2e474883c3f2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Lock "cinder-81caebce-e86a-44c4-82ee-2e474883c3f2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Acquiring lock "cinder-quobyte-81caebce-e86a-44c4-82ee-2e474883c3f2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Lock "cinder-quobyte-81caebce-e86a-44c4-82ee-2e474883c3f2" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab94ebc0-121f-49bb-9769-b2235f51d319]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:34 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2 Jul 08 01:32:34 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:34 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7" returned: 0 in 0.985s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:34 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff" returned: 0 in 0.822s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:34 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7 Jul 08 01:32:34 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Attempting download of 4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720 ((None, [{'url': 'file:///opt/stack/data/glance/images/4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'metadata': {}}])) to volume 36eb24e4-1619-4280-922e-804d4cbc19ff. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[43acf689-7352-4346-afa1-c43fbec2eb1c]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_6pdurcj2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:35 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_6pdurcj2 Jul 08 01:32:35 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:35 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd" returned: 0 in 1.080s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:35 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd Jul 08 01:32:35 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:35 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-63febe17-b2d7-41b3-ada8-1b00440a6ab7" returned: 0 in 0.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-quobyte-63febe17-b2d7-41b3-ada8-1b00440a6ab7" released by "delete_volume" :: held 1.927s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:35 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2" returned: 0 in 1.064s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:35 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_6pdurcj2" returned: 0 in 0.783s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_6pdurcj2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:35 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2 Jul 08 01:32:35 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Created reservations ['ed64f74d-a753-494f-87ed-1e729ef9df5e', 'ef42c603-1414-4b36-a6b4-a92562b7366b', 'da7ff7e0-1bf9-4148-a328-8edea03b908a', '50884c63-eab0-4690-8a25-87154f995e84'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:35 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_6pdurcj2 Jul 08 01:32:35 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:35 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:35 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:35 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.51bc8ae7-cc26-46cf-825c-d10d5f40fbcd" returned: 0 in 0.807s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-51bc8ae7-cc26-46cf-825c-d10d5f40fbcd" released by "_delete_snapshot" :: held 3.904s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" released by "delete_snapshot" :: held 3.947s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Created reservations ['d19562a9-5d13-4e36-ae63-60b95ed90f3c', 'ce979946-7f2a-4f73-ad4f-9f0010646cd8', '4cd6167c-e4dc-46b7-aab3-d902fe8ae2a3', 'ead743d1-ac87-4eea-860c-4b79e11c2675'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Delete snapshot completed successfully. Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14780d6d-a3f2-4a95-8b0b-ee3250237f07 tempest-SnapshotsActionsTest-598498727 None] Lock "cinder-51bc8ae7-cc26-46cf-825c-d10d5f40fbcd-delete_snapshot" released by "delete_snapshot" :: held 4.342s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:36 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-81caebce-e86a-44c4-82ee-2e474883c3f2" returned: 0 in 0.883s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Lock "cinder-quobyte-81caebce-e86a-44c4-82ee-2e474883c3f2" released by "delete_volume" :: held 2.009s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Created reservations ['02732c28-978a-4cc6-829e-c87bdbcfff94', '69e11494-538e-4335-93ec-0773c6223e15', 'e0182eff-ea35-4f50-a5b9-49219ba8f491', 'a497722f-186f-4657-97ff-9f6c829bd61f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:36 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_6pdurcj2" returned: 1 in 1.070s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_6pdurcj2' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a012123-3b70-4ed2-855e-b30751ab9fc6]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:36 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD Jul 08 01:32:36 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "cinder-d44f242a-95e1-4ef7-a5c3-da8b01d27175-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:37 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:37 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:37 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-d44f242a-95e1-4ef7-a5c3-da8b01d27175-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.189s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Deleted volume successfully. Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "cinder-quobyte-d44f242a-95e1-4ef7-a5c3-da8b01d27175" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ce602e95-d865-4bf9-8a72-f6bf071c9103 tempest-SnapshotMetadataTestJSON-935110408 None] Lock "cinder-63febe17-b2d7-41b3-ada8-1b00440a6ab7-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-quobyte-d44f242a-95e1-4ef7-a5c3-da8b01d27175" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Deleting offline snapshot d44f242a-95e1-4ef7-a5c3-da8b01d27175 of volume 1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] snapshot_file for this snap is: volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[973196f0-5ac6-4b1e-8b29-a5fa68bef9f2]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:37 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:32:37 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:37 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD" returned: 0 in 1.008s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:37 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.933s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:37 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Deleted volume successfully. Jul 08 01:32:37 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD Jul 08 01:32:37 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54308d29-c512-4cd8-a763-fc1d235597ef tempest-VolumesActionsTest-1959802335 None] Lock "cinder-81caebce-e86a-44c4-82ee-2e474883c3f2-delete_volume" released by "delete_volume" :: held 3.494s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:38 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 0.968s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c306273c-d351-4c91-9d26-c3d609b08d08]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:38 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 Jul 08 01:32:38 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:38 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD" returned: 1 in 0.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:32:38 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] 4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720 was raw, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:32:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:38 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff Jul 08 01:32:38 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:39 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" returned: 0 in 0.901s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:39 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:32:39 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:39 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff" returned: 0 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:39 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720_w531fljddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:32:39 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:32:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:39 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff 1G Jul 08 01:32:39 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:39 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 0.797s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:39 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175 Jul 08 01:32:39 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:40 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff 1G" returned: 0 in 0.723s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b543e2-2cd7-4b2b-859b-74a52e9e36c8]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:40 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff Jul 08 01:32:40 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:40 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96.d44f242a-95e1-4ef7-a5c3-da8b01d27175" returned: 0 in 0.663s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-quobyte-d44f242a-95e1-4ef7-a5c3-da8b01d27175" released by "_delete_snapshot" :: held 3.484s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" released by "delete_snapshot" :: held 3.513s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:41 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff" returned: 0 in 0.803s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:41 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff Jul 08 01:32:41 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:41 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff" returned: 1 in 0.788s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Downloaded image 4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720 ((None, [{'url': 'file:///opt/stack/data/glance/images/4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'metadata': {}}])) to volume 36eb24e4-1619-4280-922e-804d4cbc19ff successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:32:41 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Temporary image 4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720 for user 6519aefb32ab4332baa2941c9496b118 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Marking volume 36eb24e4-1619-4280-922e-804d4cbc19ff as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Copying metadata from image 4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720 to 36eb24e4-1619-4280-922e-804d4cbc19ff. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Creating volume glance metadata for volume 36eb24e4-1619-4280-922e-804d4cbc19ff backed by image 4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720 with: {'image_id': '4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9fac3222fff2c8976a60381fbf2fe60d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Created reservations ['1e62c231-464f-47b6-bacd-fbbefe3773cc', 'bc247bf7-7ed9-4dfd-8dec-46dfbbb4c6e4', '3773bca5-f00a-43ad-b82a-d580fee75dd3', '9e67a8ec-5b59-44d2-beaf-dfd6f36b16ee'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8031d3a-a69b-46b5-985b-3f0bd14d7f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36eb24e4-1619-4280-922e-804d4cbc19ff', 'volume_size': 1, 'image_id': '4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9fac3222fff2c8976a60381fbf2fe60d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4ebcf2529ae4a04b83e2307fb0d57fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2091c1e7e620f3518e9625160770b96037bc4a8c98cec7917afbf5f9b22ae8e2708c17bd25b510c150ee8ccc2a75146a2487e4f6c0260be519705350a9906a07', 'id': '4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720', 'created_at': datetime.datetime(2026, 7, 7, 23, 32, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 32, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4245ad5e-d0c2-4ade-b5b0-eaa9c4faf720/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96716333-4493-42ac-86ee-be6358a4b80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Volume volume-36eb24e4-1619-4280-922e-804d4cbc19ff (36eb24e4-1619-4280-922e-804d4cbc19ff): created successfully Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96716333-4493-42ac-86ee-be6358a4b80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Flow 'volume_create_manager' (337df9ac-2ff5-4db3-978c-9399a1a01ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-809c68db-9c7f-41f4-87f0-1241e48f0b34 tempest-VolumeImageDependencyTests-990593962 None] Created volume successfully. Jul 08 01:32:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Delete snapshot completed successfully. Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b012c727-815b-4a43-a3f0-fc3bc5dd2349 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-d44f242a-95e1-4ef7-a5c3-da8b01d27175-delete_snapshot" released by "delete_snapshot" :: held 6.329s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "cinder-1e7f58b6-40b2-4215-aaec-165bb6bb1a96-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-1e7f58b6-40b2-4215-aaec-165bb6bb1a96-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f592b488-b4e9-4930-ac1e-ca6afcc147ac]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:43 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 Jul 08 01:32:43 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Acquiring lock "cinder-36eb24e4-1619-4280-922e-804d4cbc19ff-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Lock "cinder-36eb24e4-1619-4280-922e-804d4cbc19ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Acquiring lock "cinder-quobyte-36eb24e4-1619-4280-922e-804d4cbc19ff" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Lock "cinder-quobyte-36eb24e4-1619-4280-922e-804d4cbc19ff" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Flow 'volume_create_manager' (5598f318-4eb2-498e-9b52-181359647188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324e1b4-2fc6-4655-9b2e-ad2fbbbb97bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dcae51-4cde-419e-942f-c8c2f5a825f9]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324e1b4-2fc6-4655-9b2e-ad2fbbbb97bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1925637395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0741177-575c-4887-9b6a-55897f6698c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc14a06afc924022b6ba8aa1e1a19ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:44Z,use_quota=True,user_id='fea60c0732ce4427bf48e89bff30fce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e40982c-7384-4788-ac14-fe81b91ef88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e40982c-7384-4788-ac14-fe81b91ef88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c26594-158a-4683-b36e-68763c956a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c26594-158a-4683-b36e-68763c956a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0741177-575c-4887-9b6a-55897f6698c1', 'volume_name': 'volume-f0741177-575c-4887-9b6a-55897f6698c1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fb4903-a60a-4789-82ab-7379e64aea9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fb4903-a60a-4789-82ab-7379e64aea9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1271244d-128a-41f7-aa7a-650f609b2701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Volume f0741177-575c-4887-9b6a-55897f6698c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0741177-575c-4887-9b6a-55897f6698c1', 'volume_size': 1} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1925637395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0741177-575c-4887-9b6a-55897f6698c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc14a06afc924022b6ba8aa1e1a19ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:44Z,use_quota=True,user_id='fea60c0732ce4427bf48e89bff30fce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Creating volume f0741177-575c-4887-9b6a-55897f6698c1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:44 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:44 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1 1073741824 Jul 08 01:32:44 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:44 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff Jul 08 01:32:44 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:44 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" returned: 0 in 1.122s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:44 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96 Jul 08 01:32:44 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:45 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff" returned: 0 in 1.004s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:45 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff Jul 08 01:32:45 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:45 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" returned: 0 in 1.138s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-quobyte-1e7f58b6-40b2-4215-aaec-165bb6bb1a96" released by "delete_volume" :: held 2.360s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:46 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1 1073741824" returned: 0 in 1.271s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Created reservations ['a072ab6f-01f8-4bc8-8bde-af9d6b3ec2a1', '90b95bd6-488c-4bbe-96fe-488b0c8aeb33', '8872e3bb-0894-404c-a644-9e651df489db', '85022737-dd45-4393-b42b-8b87ab96451d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:46 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1 Jul 08 01:32:46 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:46 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:46 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:46 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff" returned: 1 in 1.289s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:47 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff Jul 08 01:32:47 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:47 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1" returned: 0 in 1.023s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1271244d-128a-41f7-aa7a-650f609b2701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0741177-575c-4887-9b6a-55897f6698c1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2b63af-50f8-469e-826a-afe26353f44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:47 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Volume volume-f0741177-575c-4887-9b6a-55897f6698c1 (f0741177-575c-4887-9b6a-55897f6698c1): created successfully Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2b63af-50f8-469e-826a-afe26353f44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Flow 'volume_create_manager' (5598f318-4eb2-498e-9b52-181359647188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:47 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.967s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Deleted volume successfully. Jul 08 01:32:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f8942e94-d006-4ba9-ab96-516905112d2c tempest-VolumesMetadataTest-769241775 None] Created volume successfully. Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4c383a80-1dd1-4c46-b652-92f2fbd91a26 tempest-SnapshotsActionsTest-467489153 None] Lock "cinder-1e7f58b6-40b2-4215-aaec-165bb6bb1a96-delete_volume" released by "delete_volume" :: held 3.780s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:47 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-36eb24e4-1619-4280-922e-804d4cbc19ff" returned: 0 in 0.981s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Lock "cinder-quobyte-36eb24e4-1619-4280-922e-804d4cbc19ff" released by "delete_volume" :: held 3.400s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Created reservations ['731f03d7-4c16-4c4f-b470-9fc677e9fc90', '6ea398bf-dea7-4a56-adcf-59f88a2424ef', '3269052b-0b75-452a-9c5e-2caa884f077a', 'fbdd4660-7010-4ec4-85b1-51a6cfd34f24'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:48 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:48 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Acquiring lock "cinder-f0741177-575c-4887-9b6a-55897f6698c1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Lock "cinder-f0741177-575c-4887-9b6a-55897f6698c1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Acquiring lock "cinder-quobyte-f0741177-575c-4887-9b6a-55897f6698c1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Lock "cinder-quobyte-f0741177-575c-4887-9b6a-55897f6698c1" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9552140-cf49-4633-8b2d-b7611f40e96c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:48 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1 Jul 08 01:32:48 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:49 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.009s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Deleted volume successfully. Jul 08 01:32:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f4b82eb-5b7e-4ab5-8a36-2c2b001b082d tempest-VolumeImageDependencyTests-990593962 None] Lock "cinder-36eb24e4-1619-4280-922e-804d4cbc19ff-delete_volume" released by "delete_volume" :: held 4.788s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:49 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1" returned: 0 in 1.154s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:49 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1 Jul 08 01:32:49 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:50 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f0741177-575c-4887-9b6a-55897f6698c1" returned: 0 in 0.865s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Lock "cinder-quobyte-f0741177-575c-4887-9b6a-55897f6698c1" released by "delete_volume" :: held 2.099s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:50 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Created reservations ['4b1adad6-d838-4015-a387-ef0b8beb9db7', 'f13621ae-0849-41ce-91ca-24d1f343ed45', '29c9e554-2257-4e95-b25e-58e7ca413946', '0beb48c1-d1eb-4a6f-880d-f1204874aeea'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:51 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:51 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:51 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.874s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:51 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Deleted volume successfully. Jul 08 01:32:51 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=164,cinder:INSERT=64,cinder:UPDATE=207,cinder:DELETE=16 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:32:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0ed43f7-55b5-4f43-b354-56ee041232e9 tempest-VolumesMetadataTest-769241775 None] Lock "cinder-f0741177-575c-4887-9b6a-55897f6698c1-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:32:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:53 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:32:53 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:54 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.094s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:32:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:32:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:33:00 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=198,cinder:INSERT=61,cinder:SELECT=150,cinder:DELETE=15 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Flow 'volume_create_manager' (d52af15d-70da-4bac-b967-25e118c544c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf26672e-5446-43ea-87ed-3828cd990e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf26672e-5446-43ea-87ed-3828cd990e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1050580830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4694ea-fbbd-4887-ade3-e8d4843264e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec79a8c1142e44d8b474dbc31ca6a4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:01Z,use_quota=True,user_id='5396c20aba9c433ea9f72ba3ac71218a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c1e3a6-65a2-4adb-93ed-8bb38c69e04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c1e3a6-65a2-4adb-93ed-8bb38c69e04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700cf83d-6a07-4d56-baf6-ff625b3746a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700cf83d-6a07-4d56-baf6-ff625b3746a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4694ea-fbbd-4887-ade3-e8d4843264e7', 'volume_name': 'volume-af4694ea-fbbd-4887-ade3-e8d4843264e7', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903e4b6b-417c-46ab-a44d-4bf921626e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903e4b6b-417c-46ab-a44d-4bf921626e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b384bb-9298-4cce-8339-da0d8aaa7a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Volume af4694ea-fbbd-4887-ade3-e8d4843264e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4694ea-fbbd-4887-ade3-e8d4843264e7', 'volume_size': 1} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1050580830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4694ea-fbbd-4887-ade3-e8d4843264e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec79a8c1142e44d8b474dbc31ca6a4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:01Z,use_quota=True,user_id='5396c20aba9c433ea9f72ba3ac71218a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Creating volume af4694ea-fbbd-4887-ade3-e8d4843264e7 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:01 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:01 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 1073741824 Jul 08 01:33:01 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:02 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 1073741824" returned: 0 in 1.160s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:02 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 Jul 08 01:33:02 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:03 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b384bb-9298-4cce-8339-da0d8aaa7a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4694ea-fbbd-4887-ade3-e8d4843264e7', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd4dec5-f26d-473b-a41c-204e1e9dc38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Volume volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 (af4694ea-fbbd-4887-ade3-e8d4843264e7): created successfully Jul 08 01:33:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd4dec5-f26d-473b-a41c-204e1e9dc38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Flow 'volume_create_manager' (d52af15d-70da-4bac-b967-25e118c544c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-401956de-9140-4167-978b-a53d4ab836fa tempest-VolumesTransfersV355Test-1391881421 None] Created volume successfully. Jul 08 01:33:03 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Flow 'volume_create_manager' (1f98ce3a-51c9-48aa-9623-0746c8451c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b7fcd4-6326-404b-9e8d-5edb403bfea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b7fcd4-6326-404b-9e8d-5edb403bfea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-373945124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c749e8-24bb-4c56-852a-cc7750e1e750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f0ac3dcbb14221af87294c3e50f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:04Z,use_quota=True,user_id='ccd87779747745ba8b05b71d0c08a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf92192-13a3-48e2-afdb-f36025635d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf92192-13a3-48e2-afdb-f36025635d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6879d97c-aacf-45af-9739-67a1a14146e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6879d97c-aacf-45af-9739-67a1a14146e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55c749e8-24bb-4c56-852a-cc7750e1e750', 'volume_name': 'volume-55c749e8-24bb-4c56-852a-cc7750e1e750', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f138ca24-3399-4dbc-91b9-ee5e8143d3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f138ca24-3399-4dbc-91b9-ee5e8143d3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef0d0f1-0090-48cf-8146-88d8d5ab8e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Volume 55c749e8-24bb-4c56-852a-cc7750e1e750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55c749e8-24bb-4c56-852a-cc7750e1e750', 'volume_size': 1} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-373945124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c749e8-24bb-4c56-852a-cc7750e1e750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f0ac3dcbb14221af87294c3e50f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:04Z,use_quota=True,user_id='ccd87779747745ba8b05b71d0c08a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Creating volume 55c749e8-24bb-4c56-852a-cc7750e1e750 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:04 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:04 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750 1073741824 Jul 08 01:33:04 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:05 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750 1073741824" returned: 0 in 1.134s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-14c36e7c-c1c0-49f0-bb92-c83dbdc96195 tempest-VolumesTransfersV355Test-1371817780 None] Transfer volume completed successfully. Jul 08 01:33:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:05 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750 Jul 08 01:33:05 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:06 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750" returned: 0 in 0.732s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef0d0f1-0090-48cf-8146-88d8d5ab8e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55c749e8-24bb-4c56-852a-cc7750e1e750', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3ada5c-65a4-471b-9525-564ab2f5c7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:06 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Volume volume-55c749e8-24bb-4c56-852a-cc7750e1e750 (55c749e8-24bb-4c56-852a-cc7750e1e750): created successfully Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3ada5c-65a4-471b-9525-564ab2f5c7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Flow 'volume_create_manager' (1f98ce3a-51c9-48aa-9623-0746c8451c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fedbcb2d-6e5e-4c43-b7b6-4eedbf1bb9f3 tempest-VolumesListAdminTestJSON-930249507 None] Created volume successfully. Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Acquiring lock "cinder-af4694ea-fbbd-4887-ade3-e8d4843264e7-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Lock "cinder-af4694ea-fbbd-4887-ade3-e8d4843264e7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Acquiring lock "cinder-quobyte-af4694ea-fbbd-4887-ade3-e8d4843264e7" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Lock "cinder-quobyte-af4694ea-fbbd-4887-ade3-e8d4843264e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad713151-3037-4089-bb62-8fa8baf35212]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:06 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 Jul 08 01:33:06 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:06 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Flow 'volume_create_manager' (77ccddf4-3b71-467a-a8d2-115cf8c932a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34799450-5baa-493f-9d17-f26dded45a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34799450-5baa-493f-9d17-f26dded45a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1682482356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865c464d-f23e-4b36-a69d-eeb8629740cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77de802434541fd928c667c493b5331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:07Z,use_quota=True,user_id='32cff683e7c1415eb04d02e67c159d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a44227-29b6-4d76-84c4-c9ed09feb613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a44227-29b6-4d76-84c4-c9ed09feb613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d9062-2855-4af4-b12e-5ccbf7e3cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d9062-2855-4af4-b12e-5ccbf7e3cb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865c464d-f23e-4b36-a69d-eeb8629740cc', 'volume_name': 'volume-865c464d-f23e-4b36-a69d-eeb8629740cc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c47771e-d543-4aac-afee-bdd4380f486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c47771e-d543-4aac-afee-bdd4380f486e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b808c5-0cbc-4e30-8760-45bfe079e04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Volume 865c464d-f23e-4b36-a69d-eeb8629740cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865c464d-f23e-4b36-a69d-eeb8629740cc', 'volume_size': 1} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1682482356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865c464d-f23e-4b36-a69d-eeb8629740cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77de802434541fd928c667c493b5331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:07Z,use_quota=True,user_id='32cff683e7c1415eb04d02e67c159d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Creating volume 865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:07 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:07 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc 1073741824 Jul 08 01:33:07 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:07 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7" returned: 0 in 0.854s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:07 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7 Jul 08 01:33:07 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Flow 'volume_create_manager' (9f391577-14c1-404d-ab95-55753ec63dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b37360-781c-4f7a-b05e-a989ef18b155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b37360-781c-4f7a-b05e-a989ef18b155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1254405885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a5991e-9d88-4909-ab0f-12b7747735ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f0ac3dcbb14221af87294c3e50f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:08Z,use_quota=True,user_id='ccd87779747745ba8b05b71d0c08a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe167b4-d392-446a-9ba2-d9fbf45ae77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe167b4-d392-446a-9ba2-d9fbf45ae77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57e4564-0e6f-454c-bba9-c50cefba6bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57e4564-0e6f-454c-bba9-c50cefba6bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a5991e-9d88-4909-ab0f-12b7747735ee', 'volume_name': 'volume-24a5991e-9d88-4909-ab0f-12b7747735ee', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565b0165-27f1-4152-b0c6-e9a4eccd1a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565b0165-27f1-4152-b0c6-e9a4eccd1a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d61e368-baff-4e79-a145-dd555e770df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Volume 24a5991e-9d88-4909-ab0f-12b7747735ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a5991e-9d88-4909-ab0f-12b7747735ee', 'volume_size': 1} Jul 08 01:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:08 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc 1073741824" returned: 0 in 1.042s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:08 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc Jul 08 01:33:08 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:08 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-af4694ea-fbbd-4887-ade3-e8d4843264e7" returned: 0 in 0.886s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Lock "cinder-quobyte-af4694ea-fbbd-4887-ade3-e8d4843264e7" released by "delete_volume" :: held 1.795s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Created reservations ['6a26055d-b942-44ef-878d-7950f8963251', 'c7658eb2-7c41-4f7d-b353-0f0a15dca1ea', 'ab3f01a1-9d03-4419-932e-9a709c2cf5c2', 'cd75c1e2-daa4-4252-8bc7-6bf29be7effc'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:08 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:08 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:08 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc" returned: 0 in 0.687s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1254405885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a5991e-9d88-4909-ab0f-12b7747735ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f0ac3dcbb14221af87294c3e50f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:08Z,use_quota=True,user_id='ccd87779747745ba8b05b71d0c08a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Creating volume 24a5991e-9d88-4909-ab0f-12b7747735ee {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b808c5-0cbc-4e30-8760-45bfe079e04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865c464d-f23e-4b36-a69d-eeb8629740cc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99a213a-c517-4c89-b285-8dac0f875503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:08 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee 1073741824 Jul 08 01:33:08 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Volume volume-865c464d-f23e-4b36-a69d-eeb8629740cc (865c464d-f23e-4b36-a69d-eeb8629740cc): created successfully Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99a213a-c517-4c89-b285-8dac0f875503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Flow 'volume_create_manager' (77ccddf4-3b71-467a-a8d2-115cf8c932a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7ec2914e-6689-42bd-a733-cd2e9f7ddba6 tempest-VolumesCloneTest-805345481 None] Created volume successfully. Jul 08 01:33:09 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.852s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Deleted volume successfully. Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-36e251ba-850b-4470-b5fa-1b7062401e8f tempest-VolumesTransfersV355Test-1843394416 None] Lock "cinder-af4694ea-fbbd-4887-ade3-e8d4843264e7-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Flow 'volume_create_manager' (f1cb5392-5e32-4ccd-94a7-f99088be7951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c3bc3-f2cd-47e2-a83b-0682829b4998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c3bc3-f2cd-47e2-a83b-0682829b4998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1279896209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d232cd0-4445-4997-9a31-11e15eea4443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec79a8c1142e44d8b474dbc31ca6a4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:09Z,use_quota=True,user_id='5396c20aba9c433ea9f72ba3ac71218a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2e8420-bdb7-4590-b19c-87222fdf0794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2e8420-bdb7-4590-b19c-87222fdf0794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497f8fcc-e1ec-408f-b9fa-5f0ce18f3287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497f8fcc-e1ec-408f-b9fa-5f0ce18f3287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d232cd0-4445-4997-9a31-11e15eea4443', 'volume_name': 'volume-8d232cd0-4445-4997-9a31-11e15eea4443', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def55b9f-fc45-41d6-a204-df28381ebb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def55b9f-fc45-41d6-a204-df28381ebb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6253dd20-bf45-40d5-9f66-8d8549cda421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Volume 8d232cd0-4445-4997-9a31-11e15eea4443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d232cd0-4445-4997-9a31-11e15eea4443', 'volume_size': 1} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:09 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Flow 'volume_create_manager' (7d609259-14c4-469d-af11-689a5891dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13ec164-f5c3-4d9c-9c2a-542b033c359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee 1073741824" returned: 0 in 1.045s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13ec164-f5c3-4d9c-9c2a-542b033c359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1521845257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b187c46-f1b9-48ca-8e90-02cfad6577d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77de802434541fd928c667c493b5331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=865c464d-f23e-4b36-a69d-eeb8629740cc,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:10Z,use_quota=True,user_id='32cff683e7c1415eb04d02e67c159d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6ba87b-f806-494c-b423-673f868bc643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6ba87b-f806-494c-b423-673f868bc643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1178a112-46cb-4755-b892-178bfef4b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1178a112-46cb-4755-b892-178bfef4b897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0b187c46-f1b9-48ca-8e90-02cfad6577d0', 'volume_name': 'volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0', 'volume_size': 2, 'source_volid': '865c464d-f23e-4b36-a69d-eeb8629740cc', 'source_volstatus': 'available'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8d81a4-02ce-45d7-9dbd-ccdfcef41e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8d81a4-02ce-45d7-9dbd-ccdfcef41e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71b75d1-3744-4d6e-b0ef-3edc5df2aa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Volume 0b187c46-f1b9-48ca-8e90-02cfad6577d0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0', 'volume_size': 2, 'source_volid': '865c464d-f23e-4b36-a69d-eeb8629740cc', 'source_volstatus': 'available'} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:10 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee Jul 08 01:33:10 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:10 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee" returned: 0 in 0.657s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.090s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1279896209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d232cd0-4445-4997-9a31-11e15eea4443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec79a8c1142e44d8b474dbc31ca6a4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:09Z,use_quota=True,user_id='5396c20aba9c433ea9f72ba3ac71218a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Creating volume 8d232cd0-4445-4997-9a31-11e15eea4443 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:10 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d61e368-baff-4e79-a145-dd555e770df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a5991e-9d88-4909-ab0f-12b7747735ee', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:10 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443 1073741824 Jul 08 01:33:10 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e843a52b-7f60-4f97-b79d-6fc3af51ef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Volume volume-24a5991e-9d88-4909-ab0f-12b7747735ee (24a5991e-9d88-4909-ab0f-12b7747735ee): created successfully Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e843a52b-7f60-4f97-b79d-6fc3af51ef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Flow 'volume_create_manager' (9f391577-14c1-404d-ab95-55753ec63dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c947ba26-7fcc-4ed3-a25a-02eb77087253 tempest-VolumesListAdminTestJSON-930249507 None] Created volume successfully. Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Flow 'volume_create_manager' (1ffb8ce0-ecaf-48f4-b8ce-5233b782c740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07599411-13c4-4bb5-93b1-9c18a7281b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07599411-13c4-4bb5-93b1-9c18a7281b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-231537417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02817cb3-6f48-4ca7-8791-19951bd9afc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f0ac3dcbb14221af87294c3e50f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:11Z,use_quota=True,user_id='ccd87779747745ba8b05b71d0c08a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae621ff-77bd-4367-a1cf-d20ccec40fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae621ff-77bd-4367-a1cf-d20ccec40fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcf9b5b-68fd-4ade-b32d-23c2c6defc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcf9b5b-68fd-4ade-b32d-23c2c6defc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02817cb3-6f48-4ca7-8791-19951bd9afc9', 'volume_name': 'volume-02817cb3-6f48-4ca7-8791-19951bd9afc9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315c441b-de8f-4632-a7df-996134423741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315c441b-de8f-4632-a7df-996134423741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87524ba-c204-4b81-99b0-f1482e2538c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:11 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Volume 02817cb3-6f48-4ca7-8791-19951bd9afc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02817cb3-6f48-4ca7-8791-19951bd9afc9', 'volume_size': 1} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:11 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443 1073741824" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:11 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443 Jul 08 01:33:11 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:12 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443" returned: 0 in 0.723s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.363s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:12 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Cloning volume 865c464d-f23e-4b36-a69d-eeb8629740cc to volume 0b187c46-f1b9-48ca-8e90-02cfad6577d0 Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6253dd20-bf45-40d5-9f66-8d8549cda421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d232cd0-4445-4997-9a31-11e15eea4443', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7c5e2d-e568-452b-8eba-4cd68242ea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Volume volume-8d232cd0-4445-4997-9a31-11e15eea4443 (8d232cd0-4445-4997-9a31-11e15eea4443): created successfully Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7c5e2d-e568-452b-8eba-4cd68242ea38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Flow 'volume_create_manager' (f1cb5392-5e32-4ccd-94a7-f99088be7951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-48b6de6b-0c4b-42ca-bcb0-7e548d6174f9 tempest-VolumesTransfersV355Test-1391881421 None] Created volume successfully. Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Creating offline snapshot 64b5073f-682e-4af0-836f-681096a725c8 of volume 865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[37512df4-e594-4867-8a59-b871597c4d8e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:12 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc Jul 08 01:33:12 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Acquiring lock "cinder-8d232cd0-4445-4997-9a31-11e15eea4443-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Lock "cinder-8d232cd0-4445-4997-9a31-11e15eea4443-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Acquiring lock "cinder-quobyte-8d232cd0-4445-4997-9a31-11e15eea4443" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Lock "cinder-quobyte-8d232cd0-4445-4997-9a31-11e15eea4443" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[501c0b6f-b61e-4946-96e2-325309d22795]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:13 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443 Jul 08 01:33:13 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:13 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc" returned: 0 in 0.878s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:13 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 1G Jul 08 01:33:13 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:13 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443" returned: 0 in 0.849s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:13 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443 Jul 08 01:33:13 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:14 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 1G" returned: 0 in 0.897s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-865c464d-f23e-4b36-a69d-eeb8629740cc -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:14 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-865c464d-f23e-4b36-a69d-eeb8629740cc -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 Jul 08 01:33:14 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:14 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8d232cd0-4445-4997-9a31-11e15eea4443" returned: 0 in 0.722s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Lock "cinder-quobyte-8d232cd0-4445-4997-9a31-11e15eea4443" released by "delete_volume" :: held 1.613s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Created reservations ['51fa14d7-3626-4ed7-99b8-8f31551227f9', '1bdc588a-64f3-4b0a-96db-7dfdca5d967a', '711a0d53-8d12-42b3-9944-15be1787072b', 'cea6fe93-7342-4ce3-af2b-4fb7f38e2e7e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:14 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:14 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:15 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-865c464d-f23e-4b36-a69d-eeb8629740cc -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8" returned: 0 in 0.718s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:15 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 is being set with open permissions: ugo+rw Jul 08 01:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:15 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 Jul 08 01:33:15 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:15 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Deleted volume successfully. Jul 08 01:33:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43f4b35c-197c-45c1-9860-4011b5d0978c tempest-VolumesTransfersV355Test-1843394416 None] Lock "cinder-8d232cd0-4445-4997-9a31-11e15eea4443-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:15 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:15 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.info Jul 08 01:33:15 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:16 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.info" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:16 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.info is being set with open permissions: ugo+rw Jul 08 01:33:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:16 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.info Jul 08 01:33:16 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:17 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.info" returned: 0 in 0.777s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Acquiring lock "cinder-quobyte-0b187c46-f1b9-48ca-8e90-02cfad6577d0" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Lock "cinder-quobyte-0b187c46-f1b9-48ca-8e90-02cfad6577d0" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] snapshot: 64b5073f-682e-4af0-836f-681096a725c8, volume: 0b187c46-f1b9-48ca-8e90-02cfad6577d0, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94fd02a-349f-403e-b0cd-a2dcb16dcc6a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:17 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 Jul 08 01:33:17 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:18 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8" returned: 0 in 0.843s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-865c464d-f23e-4b36-a69d-eeb8629740cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:33:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:33:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:33:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e37321-9aef-4487-80ad-253a7567ce39]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:18 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc Jul 08 01:33:18 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:19 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc" returned: 0 in 0.891s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:19 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:33:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:19 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 Jul 08 01:33:19 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:24 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0" returned: 0 in 5.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3f5407-a3df-40fd-962d-de8f146b8eca]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:25 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc Jul 08 01:33:25 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:26 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc" returned: 0 in 1.045s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:33:26 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Converted 1024.00 MB image at 178.28 MB/s Jul 08 01:33:26 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 is being set with open permissions: ugo+rw Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:26 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 Jul 08 01:33:26 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=37,cinder:SELECT=22,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:33:26 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0" returned: 0 in 0.771s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Lock "cinder-quobyte-0b187c46-f1b9-48ca-8e90-02cfad6577d0" released by "_copy_volume_from_snapshot" :: held 9.413s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Acquiring lock "cinder-quobyte-64b5073f-682e-4af0-836f-681096a725c8" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Lock "cinder-quobyte-64b5073f-682e-4af0-836f-681096a725c8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Deleting offline snapshot 64b5073f-682e-4af0-836f-681096a725c8 of volume 865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] snapshot_file for this snap is: volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[800c72de-0668-4c53-b3cb-5ccfc7890a13]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:27 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 Jul 08 01:33:27 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:27 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8" returned: 0 in 0.953s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-865c464d-f23e-4b36-a69d-eeb8629740cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:33:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd37f59-61a5-4ab3-a19c-7ba9af079f15]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:27 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc Jul 08 01:33:27 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:28 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:28 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 Jul 08 01:33:28 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:29 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8" returned: 0 in 0.982s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:29 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8 Jul 08 01:33:29 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:30 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc.64b5073f-682e-4af0-836f-681096a725c8" returned: 0 in 0.824s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Lock "cinder-quobyte-64b5073f-682e-4af0-836f-681096a725c8" released by "_delete_snapshot" :: held 3.734s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.218s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.053s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-231537417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02817cb3-6f48-4ca7-8791-19951bd9afc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f0ac3dcbb14221af87294c3e50f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:11Z,use_quota=True,user_id='ccd87779747745ba8b05b71d0c08a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Creating volume 02817cb3-6f48-4ca7-8791-19951bd9afc9 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:30 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:30 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 1073741824 Jul 08 01:33:30 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71b75d1-3744-4d6e-b0ef-3edc5df2aa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0', 'volume_size': 2, 'source_volid': '865c464d-f23e-4b36-a69d-eeb8629740cc', 'source_volstatus': 'available'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47f7982-8161-4a48-bc91-65754f594e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Volume volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 (0b187c46-f1b9-48ca-8e90-02cfad6577d0): created successfully Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47f7982-8161-4a48-bc91-65754f594e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Flow 'volume_create_manager' (7d609259-14c4-469d-af11-689a5891dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7c52b00a-0872-440e-bc7d-12d0d033d417 tempest-VolumesCloneTest-805345481 None] Created volume successfully. Jul 08 01:33:31 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 1073741824" returned: 0 in 1.172s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:31 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 Jul 08 01:33:31 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Acquiring lock "cinder-0b187c46-f1b9-48ca-8e90-02cfad6577d0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Lock "cinder-0b187c46-f1b9-48ca-8e90-02cfad6577d0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Acquiring lock "cinder-quobyte-0b187c46-f1b9-48ca-8e90-02cfad6577d0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Lock "cinder-quobyte-0b187c46-f1b9-48ca-8e90-02cfad6577d0" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[977f1eeb-3d76-45c8-b2ad-dbb6599102df]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:32 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 Jul 08 01:33:32 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:32 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9" returned: 0 in 0.761s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87524ba-c204-4b81-99b0-f1482e2538c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02817cb3-6f48-4ca7-8791-19951bd9afc9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8c0da0-3ea5-4f1a-85bd-76d4bc65258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Volume volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 (02817cb3-6f48-4ca7-8791-19951bd9afc9): created successfully Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8c0da0-3ea5-4f1a-85bd-76d4bc65258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Flow 'volume_create_manager' (1ffb8ce0-ecaf-48f4-b8ce-5233b782c740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-93f146b4-5d62-4af9-856a-e228a675d124 tempest-VolumesListAdminTestJSON-930249507 None] Created volume successfully. Jul 08 01:33:33 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0" returned: 0 in 0.940s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:33 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0 Jul 08 01:33:33 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:34 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0b187c46-f1b9-48ca-8e90-02cfad6577d0" returned: 0 in 0.999s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Lock "cinder-quobyte-0b187c46-f1b9-48ca-8e90-02cfad6577d0" released by "delete_volume" :: held 2.009s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Created reservations ['5877f5a0-4e0f-4aa7-a4c3-1bb141de6b0f', '7e78bb33-a460-4960-bd80-f40c5cf139c7', 'c83c7f2f-949c-4735-a7b2-f1c581fc155c', '008abd77-5e3e-46a8-bf1a-c3ba07a8f263'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:34 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:34 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Flow 'volume_create_manager' (1924da00-1b93-46a0-b30f-29a0854d9ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b852495-5460-4f92-ba73-fe70f24e1dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Acquiring lock "cinder-865c464d-f23e-4b36-a69d-eeb8629740cc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b852495-5460-4f92-ba73-fe70f24e1dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6791d22-9a46-4454-99bc-bb2b238ec379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ffa61afa57d4ae8a6c8dc3ca034caf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:34Z,use_quota=True,user_id='4dcdcda6cf4d4966b540497164a6cac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1c2443-7fa5-48fc-ba0f-9b07ff8f7a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1c2443-7fa5-48fc-ba0f-9b07ff8f7a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82bd70b-5847-46bd-a22b-e9165a9be07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82bd70b-5847-46bd-a22b-e9165a9be07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6791d22-9a46-4454-99bc-bb2b238ec379', 'volume_name': 'volume-c6791d22-9a46-4454-99bc-bb2b238ec379', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c041f7-117e-4d0b-a1fa-06aad60213e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c041f7-117e-4d0b-a1fa-06aad60213e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ff6f70-cb0a-42ef-bf3e-efefb6894f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:34 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Volume c6791d22-9a46-4454-99bc-bb2b238ec379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6791d22-9a46-4454-99bc-bb2b238ec379', 'volume_size': 1} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6791d22-9a46-4454-99bc-bb2b238ec379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ffa61afa57d4ae8a6c8dc3ca034caf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:34Z,use_quota=True,user_id='4dcdcda6cf4d4966b540497164a6cac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Creating volume c6791d22-9a46-4454-99bc-bb2b238ec379 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:34 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Lock "cinder-865c464d-f23e-4b36-a69d-eeb8629740cc-delete_volume" acquired by "delete_volume" :: waited 0.143s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:34 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379 1073741824 Jul 08 01:33:34 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Acquiring lock "cinder-quobyte-865c464d-f23e-4b36-a69d-eeb8629740cc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Lock "cinder-quobyte-865c464d-f23e-4b36-a69d-eeb8629740cc" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6214f6bc-6698-45e0-adcc-6731a9b59553]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:35 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Flow 'volume_create_manager' (90378628-d395-4315-b0e2-e5c6465ad795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:35 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0917d373-99ff-4ee0-8bce-d98f31f06ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0917d373-99ff-4ee0-8bce-d98f31f06ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1699298013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e342a2-d1cb-42c3-80f6-5291c12a5ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f03d033523464cbc211826bb28e09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:35Z,use_quota=True,user_id='0845c2b796724d689cdb4033b67f1866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969cc5b6-1aa8-4679-8f9d-9f3adc896703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969cc5b6-1aa8-4679-8f9d-9f3adc896703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a2bc63-f4ab-417b-b2d8-cf70e3212ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a2bc63-f4ab-417b-b2d8-cf70e3212ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e342a2-d1cb-42c3-80f6-5291c12a5ac8', 'volume_name': 'volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8698b-0672-47fc-9781-299462269721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8698b-0672-47fc-9781-299462269721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a7299a-4436-4536-879e-e6e2f298dc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:35 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Volume 22e342a2-d1cb-42c3-80f6-5291c12a5ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8', 'volume_size': 1} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:35 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.097s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Deleted volume successfully. Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cb3dba9-2826-489b-acfe-60d39fd620f1 tempest-VolumesCloneTest-805345481 None] Lock "cinder-0b187c46-f1b9-48ca-8e90-02cfad6577d0-delete_volume" released by "delete_volume" :: held 3.515s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:35 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379 1073741824" returned: 0 in 1.073s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:35 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379 Jul 08 01:33:35 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:35 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc" returned: 0 in 0.959s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:35 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc Jul 08 01:33:35 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:36 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379" returned: 0 in 0.694s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1699298013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e342a2-d1cb-42c3-80f6-5291c12a5ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f03d033523464cbc211826bb28e09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:35Z,use_quota=True,user_id='0845c2b796724d689cdb4033b67f1866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Creating volume 22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:36 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:36 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 1073741824 Jul 08 01:33:36 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ff6f70-cb0a-42ef-bf3e-efefb6894f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6791d22-9a46-4454-99bc-bb2b238ec379', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402b47e3-b85f-43e0-9841-dbc9a3ab0ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:36 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Volume volume-c6791d22-9a46-4454-99bc-bb2b238ec379 (c6791d22-9a46-4454-99bc-bb2b238ec379): created successfully Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402b47e3-b85f-43e0-9841-dbc9a3ab0ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Flow 'volume_create_manager' (1924da00-1b93-46a0-b30f-29a0854d9ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:36 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-865c464d-f23e-4b36-a69d-eeb8629740cc" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-82b226d4-86ae-4d25-ad9f-835120aa37ac tempest-VolumesListAdminTestJSON-1242421825 None] Created volume successfully. Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Lock "cinder-quobyte-865c464d-f23e-4b36-a69d-eeb8629740cc" released by "delete_volume" :: held 1.815s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Created reservations ['10a23bd9-c259-4ba2-bfa6-5940d229ed77', '2e582f77-c060-4875-984b-ae171d80dbb5', 'd5ef8650-5fdf-4f5e-ab88-da69433fb65d', '4a38fe2d-f87b-4991-b3b4-663db0351b9c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:36 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:36 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:37 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:37 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 1073741824" returned: 0 in 1.062s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Deleted volume successfully. Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72389ce7-020b-4faa-9a63-59f40ba3eb43 tempest-VolumesCloneTest-805345481 None] Lock "cinder-865c464d-f23e-4b36-a69d-eeb8629740cc-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:37 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 Jul 08 01:33:37 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Acquiring lock "cinder-c6791d22-9a46-4454-99bc-bb2b238ec379-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Lock "cinder-c6791d22-9a46-4454-99bc-bb2b238ec379-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Acquiring lock "cinder-quobyte-c6791d22-9a46-4454-99bc-bb2b238ec379" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Lock "cinder-quobyte-c6791d22-9a46-4454-99bc-bb2b238ec379" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e6e31f-fb1a-43f2-9e88-1622a60b9c6d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "cinder-02817cb3-6f48-4ca7-8791-19951bd9afc9-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-02817cb3-6f48-4ca7-8791-19951bd9afc9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:38 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379 Jul 08 01:33:38 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "cinder-quobyte-02817cb3-6f48-4ca7-8791-19951bd9afc9" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-quobyte-02817cb3-6f48-4ca7-8791-19951bd9afc9" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[357eae8c-709c-4674-a5ea-4f46550931c1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:38 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 Jul 08 01:33:38 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:38 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a7299a-4436-4536-879e-e6e2f298dc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397959b7-2dd0-4f32-8989-e4c3f4574e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:38 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Volume volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 (22e342a2-d1cb-42c3-80f6-5291c12a5ac8): created successfully Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397959b7-2dd0-4f32-8989-e4c3f4574e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Flow 'volume_create_manager' (90378628-d395-4315-b0e2-e5c6465ad795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b0ada338-f230-4e62-be0a-1a0ced2666d6 tempest-VolumesActionsTest-399751391 None] Created volume successfully. Jul 08 01:33:38 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379" returned: 0 in 0.987s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:38 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379 Jul 08 01:33:39 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:39 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9" returned: 0 in 1.124s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:39 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9 Jul 08 01:33:39 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:39 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6791d22-9a46-4454-99bc-bb2b238ec379" returned: 0 in 0.785s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Lock "cinder-quobyte-c6791d22-9a46-4454-99bc-bb2b238ec379" released by "delete_volume" :: held 1.839s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Created reservations ['ed355af8-ffdc-467a-8d4d-4a79ce6269c5', '3c354aad-0a76-44f0-a1cd-50e76327418c', 'd259e88c-cbf6-4ba6-8495-736377210f71', 'b8a773e7-de77-4620-bed9-5164f6c0607e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:39 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:39 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:40 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-02817cb3-6f48-4ca7-8791-19951bd9afc9" returned: 0 in 0.835s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-quobyte-02817cb3-6f48-4ca7-8791-19951bd9afc9" released by "delete_volume" :: held 2.040s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Created reservations ['2f5ab504-9f7b-47fb-937b-78f55c17a9da', 'd2f4f41b-d0aa-434c-bec3-9ad8539b1dcd', 'e057447c-a521-4e5a-aba5-fb2a82b4fa5c', '5dcee4ee-e27f-4130-a95f-d743ff692ad4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:40 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:40 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:40 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.984s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Deleted volume successfully. Jul 08 01:33:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe17d329-fdce-48d7-a6bc-31a05e5bc9dd tempest-VolumesListAdminTestJSON-1242421825 None] Lock "cinder-c6791d22-9a46-4454-99bc-bb2b238ec379-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:41 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Deleted volume successfully. Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-abfcc09d-c482-46ef-a2a0-37ea2f67a0fd tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-02817cb3-6f48-4ca7-8791-19951bd9afc9-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Flow 'volume_create_manager' (0275b11e-5a00-4462-8aa7-88790acc3972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0535b40c-dd5b-4f52-8d96-6f1dae77f53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0535b40c-dd5b-4f52-8d96-6f1dae77f53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1964031617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae09a3b4-ff6f-47e2-896c-571ec268d88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a5223b33b4e5ba57f6c5510803a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:41Z,use_quota=True,user_id='54bca4846e704127afadfbe5871e45e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ae1b68-587d-4c94-b307-84d71df3507e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ae1b68-587d-4c94-b307-84d71df3507e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1cde61-20c1-4a16-8807-89617ffaaed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1cde61-20c1-4a16-8807-89617ffaaed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae09a3b4-ff6f-47e2-896c-571ec268d88e', 'volume_name': 'volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e', 'volume_size': 2}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b69489-445c-4be9-96a2-69261c6133b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b69489-445c-4be9-96a2-69261c6133b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4168a316-cc39-4820-aa9b-bf3ff3cf10a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Volume ae09a3b4-ff6f-47e2-896c-571ec268d88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e', 'volume_size': 2} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1964031617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae09a3b4-ff6f-47e2-896c-571ec268d88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a5223b33b4e5ba57f6c5510803a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:41Z,use_quota=True,user_id='54bca4846e704127afadfbe5871e45e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Creating volume ae09a3b4-ff6f-47e2-896c-571ec268d88e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:41 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e 2147483648 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "cinder-24a5991e-9d88-4909-ab0f-12b7747735ee-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:41 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e 2147483648 Jul 08 01:33:41 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-24a5991e-9d88-4909-ab0f-12b7747735ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "cinder-quobyte-24a5991e-9d88-4909-ab0f-12b7747735ee" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-quobyte-24a5991e-9d88-4909-ab0f-12b7747735ee" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[662ff806-4193-462a-ae3b-8fbebd36f562]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:41 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee Jul 08 01:33:41 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:42 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee" returned: 0 in 0.929s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:42 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e 2147483648" returned: 0 in 1.098s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:42 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee Jul 08 01:33:42 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:42 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e Jul 08 01:33:42 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:43 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24a5991e-9d88-4909-ab0f-12b7747735ee" returned: 0 in 0.712s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-quobyte-24a5991e-9d88-4909-ab0f-12b7747735ee" released by "delete_volume" :: held 1.698s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:43 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Created reservations ['94042212-38ce-4a48-8719-606dde460ad4', 'c2b2ab96-747d-45d2-958d-b00dcfe4b00c', '135154dd-dadf-44bc-8ebd-80b105e55aaa', '9cb1fc0b-4308-49a4-805d-d90e5dfb3b99'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4168a316-cc39-4820-aa9b-bf3ff3cf10a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e', 'volume_size': 2}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0327276-8f9e-4c4d-9eb1-b6dd5af683a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Volume volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e (ae09a3b4-ff6f-47e2-896c-571ec268d88e): created successfully Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0327276-8f9e-4c4d-9eb1-b6dd5af683a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Flow 'volume_create_manager' (0275b11e-5a00-4462-8aa7-88790acc3972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c6c6c89e-06eb-4ce6-8780-42b1175073ca tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Created volume successfully. Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:43 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:43 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "cinder-55c749e8-24bb-4c56-852a-cc7750e1e750-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-55c749e8-24bb-4c56-852a-cc7750e1e750-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "cinder-quobyte-55c749e8-24bb-4c56-852a-cc7750e1e750" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-quobyte-55c749e8-24bb-4c56-852a-cc7750e1e750" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1741fef2-185e-4647-b322-798a0e2224f5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:44 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750 Jul 08 01:33:44 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:44 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.705s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Deleted volume successfully. Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516138b-e6da-4549-bb1f-b7540db4d2c3 tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-24a5991e-9d88-4909-ab0f-12b7747735ee-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Creating offline snapshot b5a67cf6-4886-417e-bf07-069d348779b4 of volume ae09a3b4-ff6f-47e2-896c-571ec268d88e {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb20373b-1be6-4865-89fb-efa36dcaff38]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:44 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750" returned: 0 in 0.861s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:45 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750 Jul 08 01:33:45 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:45 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e Jul 08 01:33:45 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:45 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-55c749e8-24bb-4c56-852a-cc7750e1e750" returned: 0 in 0.736s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-quobyte-55c749e8-24bb-4c56-852a-cc7750e1e750" released by "delete_volume" :: held 1.646s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Created reservations ['783284ea-655d-4eae-8103-e00d257251c1', '976dcb70-cd24-4ac6-901b-01b4a87e87e4', 'e6c19276-f304-41db-8aa1-ba554b6e7343', '3fc12f62-d8dd-4bf5-bc77-8dcb000a9a7b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:45 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e" returned: 0 in 0.895s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 2G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:45 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 2G Jul 08 01:33:45 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:45 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:45 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:46 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 2G" returned: 0 in 1.068s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:46 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 Jul 08 01:33:46 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:47 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.074s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:47 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Deleted volume successfully. Jul 08 01:33:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed336f43-6dea-4e3e-94de-9ada0fd1894c tempest-VolumesListAdminTestJSON-930249507 None] Lock "cinder-55c749e8-24bb-4c56-852a-cc7750e1e750-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:47 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4" returned: 0 in 1.032s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:47 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 is being set with open permissions: ugo+rw Jul 08 01:33:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:47 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 Jul 08 01:33:47 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:48 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:48 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.info Jul 08 01:33:48 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:49 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.info" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:49 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.info is being set with open permissions: ugo+rw Jul 08 01:33:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:49 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.info Jul 08 01:33:49 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:50 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.info" returned: 0 in 0.802s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.577s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3d9f4d71-7838-4d7a-bd1c-99ba7720bac4 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Create snapshot completed successfully Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Acquiring lock "cinder-b5a67cf6-4886-417e-bf07-069d348779b4-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-b5a67cf6-4886-417e-bf07-069d348779b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Acquiring lock "cinder-quobyte-ae09a3b4-ff6f-47e2-896c-571ec268d88e" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-quobyte-ae09a3b4-ff6f-47e2-896c-571ec268d88e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Acquiring lock "cinder-quobyte-b5a67cf6-4886-417e-bf07-069d348779b4" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-quobyte-b5a67cf6-4886-417e-bf07-069d348779b4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Deleting offline snapshot b5a67cf6-4886-417e-bf07-069d348779b4 of volume ae09a3b4-ff6f-47e2-896c-571ec268d88e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] snapshot_file for this snap is: volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc23f5d-bed4-412c-815d-e0e199282af6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Flow 'volume_create_manager' (a8634221-3886-49db-ab4d-48a81dc8636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb9f84b-4d3e-4c5c-9e32-96866b07f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:51 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 Jul 08 01:33:51 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb9f84b-4d3e-4c5c-9e32-96866b07f94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-599563427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818076e1-4008-4772-a252-337577b0c7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53eaea64dd5d4107b119b04ce64b1dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:52Z,use_quota=True,user_id='e8d54cb255764175bdf9e18765162fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d92624-c2d6-4e9f-bd91-c51ee9d7875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d92624-c2d6-4e9f-bd91-c51ee9d7875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b33d38-7702-4c26-ad11-b822155f84a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b33d38-7702-4c26-ad11-b822155f84a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818076e1-4008-4772-a252-337577b0c7c0', 'volume_name': 'volume-818076e1-4008-4772-a252-337577b0c7c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118c4183-715a-4e8c-acaf-ebc536a426ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118c4183-715a-4e8c-acaf-ebc536a426ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79eb02a-215b-4a88-8f3b-746af5af2611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Volume 818076e1-4008-4772-a252-337577b0c7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818076e1-4008-4772-a252-337577b0c7c0', 'volume_size': 1} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-599563427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818076e1-4008-4772-a252-337577b0c7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53eaea64dd5d4107b119b04ce64b1dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:52Z,use_quota=True,user_id='e8d54cb255764175bdf9e18765162fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Creating volume 818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:51 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:33:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:51 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 1073741824 Jul 08 01:33:51 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:52 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4" returned: 0 in 1.229s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:33:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3668234-cf4d-4186-afb2-8ae719a9d0ac]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:52 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e Jul 08 01:33:52 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:52 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 1073741824" returned: 0 in 1.306s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:53 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 Jul 08 01:33:53 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:53 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:53 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:53 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e" returned: 0 in 0.920s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:53 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 Jul 08 01:33:53 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:53 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0" returned: 0 in 0.764s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79eb02a-215b-4a88-8f3b-746af5af2611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818076e1-4008-4772-a252-337577b0c7c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644770ee-78cd-464a-b216-a8e3104b2f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Volume volume-818076e1-4008-4772-a252-337577b0c7c0 (818076e1-4008-4772-a252-337577b0c7c0): created successfully Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644770ee-78cd-464a-b216-a8e3104b2f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Flow 'volume_create_manager' (a8634221-3886-49db-ab4d-48a81dc8636b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9e394d84-25b8-4b65-81b6-ebfc66c96f4c tempest-VolumesDeleteCascade-46065553 None] Created volume successfully. Jul 08 01:33:54 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:33:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:33:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:33:54 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4" returned: 0 in 0.967s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:54 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4 Jul 08 01:33:54 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Creating offline snapshot b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a of volume 818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:33:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34264c8-f939-4684-9978-0837bfc536ad]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:55 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 Jul 08 01:33:55 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:55 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e.b5a67cf6-4886-417e-bf07-069d348779b4" returned: 0 in 0.844s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-quobyte-b5a67cf6-4886-417e-bf07-069d348779b4" released by "_delete_snapshot" :: held 4.138s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-quobyte-ae09a3b4-ff6f-47e2-896c-571ec268d88e" released by "delete_snapshot" :: held 4.173s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Created reservations ['0700aac5-018d-41d9-ba3b-e10ce6a860a7', 'e648d007-2ca0-4244-bb2f-5b7e1659d56b', 'e3ea88d3-e4e2-4e97-99f3-a957a8947d55', 'a2d5b707-836d-4ef7-804a-ef47d6c38bb3'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Delete snapshot completed successfully. Jul 08 01:33:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8d00f60-8626-46e5-a4a0-faa491d131a7 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-b5a67cf6-4886-417e-bf07-069d348779b4-delete_snapshot" released by "delete_snapshot" :: held 4.403s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:56 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0" returned: 0 in 1.058s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:56 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a 1G Jul 08 01:33:56 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Acquiring lock "cinder-ae09a3b4-ff6f-47e2-896c-571ec268d88e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-ae09a3b4-ff6f-47e2-896c-571ec268d88e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Acquiring lock "cinder-quobyte-ae09a3b4-ff6f-47e2-896c-571ec268d88e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-quobyte-ae09a3b4-ff6f-47e2-896c-571ec268d88e" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9ef622-e689-4e7b-a42d-023c1d431850]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16146d07-73e6-4479-90f4-3839c01d5e61 tempest-VolumesActionsTest-399751391 None] Acquiring lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" by "attach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16146d07-73e6-4479-90f4-3839c01d5e61 tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" acquired by "attach_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:57 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a 1G" returned: 0 in 1.112s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-818076e1-4008-4772-a252-337577b0c7c0 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:57 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-818076e1-4008-4772-a252-337577b0c7c0 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a Jul 08 01:33:57 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:57 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e Jul 08 01:33:57 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-16146d07-73e6-4479-90f4-3839c01d5e61 tempest-VolumesActionsTest-399751391 None] Attaching volume 22e342a2-d1cb-42c3-80f6-5291c12a5ac8 to instance 52bd61b7-488a-4e7b-8895-054552d6c589 at mountpoint /dev/vdb on host None. Jul 08 01:33:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-16146d07-73e6-4479-90f4-3839c01d5e61 tempest-VolumesActionsTest-399751391 None] Attach volume completed successfully. Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16146d07-73e6-4479-90f4-3839c01d5e61 tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" released by "attach_volume" :: held 0.204s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9bfb9d3d-8f39-4984-98d0-0de45e4c003b tempest-VolumesActionsTest-399751391 None] Acquiring lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8-detach_volume" by "detach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9bfb9d3d-8f39-4984-98d0-0de45e4c003b tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9bfb9d3d-8f39-4984-98d0-0de45e4c003b tempest-VolumesActionsTest-399751391 None] Detaching volume 22e342a2-d1cb-42c3-80f6-5291c12a5ac8 from instance 52bd61b7-488a-4e7b-8895-054552d6c589. Jul 08 01:33:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9bfb9d3d-8f39-4984-98d0-0de45e4c003b tempest-VolumesActionsTest-399751391 None] Detach volume completed successfully. Jul 08 01:33:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9bfb9d3d-8f39-4984-98d0-0de45e4c003b tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:58 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-818076e1-4008-4772-a252-337577b0c7c0 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:58 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a is being set with open permissions: ugo+rw Jul 08 01:33:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:58 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e" returned: 0 in 1.001s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:58 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a Jul 08 01:33:58 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:58 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e Jul 08 01:33:58 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:58 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" returned: 0 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:58 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ae09a3b4-ff6f-47e2-896c-571ec268d88e" returned: 0 in 0.876s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:58 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.info Jul 08 01:33:58 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-quobyte-ae09a3b4-ff6f-47e2-896c-571ec268d88e" released by "delete_volume" :: held 1.974s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Created reservations ['de2c5f83-c94c-4966-899b-fba995e05777', '7b2312a2-f2a9-4eda-9237-0e87eb5f4050', '88317a2b-74ee-4645-928e-7f8c9b9a81ed', 'a56ae0a3-8bad-4bad-a615-4303e91209ae'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:59 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:33:59 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:59 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.info" returned: 0 in 0.903s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:59 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.info is being set with open permissions: ugo+rw Jul 08 01:33:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:59 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.info Jul 08 01:33:59 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:00 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.870s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:00 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Deleted volume successfully. Jul 08 01:34:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fae2e9f0-5247-4eb6-b625-865fd8473719 tempest-VolumesSnapshotNegativeTestJSON-1156761436 None] Lock "cinder-ae09a3b4-ff6f-47e2-896c-571ec268d88e-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:00 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.info" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.733s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-829b2ca9-097a-4e3f-bbd2-5d583d7cbff8 tempest-VolumesDeleteCascade-46065553 None] Create snapshot completed successfully Jul 08 01:34:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Creating offline snapshot 6761b8a2-d608-4d1d-af1f-b56d24131d64 of volume 818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:34:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e323755-cc10-4251-a454-50e8e5ba0eb5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:01 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a Jul 08 01:34:01 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:02 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" returned: 0 in 0.850s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-818076e1-4008-4772-a252-337577b0c7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:34:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:02 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 1G Jul 08 01:34:02 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:03 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 1G" returned: 0 in 0.990s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:03 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 Jul 08 01:34:03 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:04 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64" returned: 0 in 0.869s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:04 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 is being set with open permissions: ugo+rw Jul 08 01:34:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:04 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 Jul 08 01:34:04 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:05 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.575s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ff7750f9-9e42-4285-9cc1-bc364b08e613 tempest-VolumesDeleteCascade-46065553 None] Create snapshot completed successfully Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-818076e1-4008-4772-a252-337577b0c7c0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-818076e1-4008-4772-a252-337577b0c7c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Performing cascade delete. {{(pid=87204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-6761b8a2-d608-4d1d-af1f-b56d24131d64-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-6761b8a2-d608-4d1d-af1f-b56d24131d64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-818076e1-4008-4772-a252-337577b0c7c0" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-818076e1-4008-4772-a252-337577b0c7c0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-6761b8a2-d608-4d1d-af1f-b56d24131d64" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-6761b8a2-d608-4d1d-af1f-b56d24131d64" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Deleting offline snapshot 6761b8a2-d608-4d1d-af1f-b56d24131d64 of volume 818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:34:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] snapshot_file for this snap is: volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:34:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eb7caa-70fe-4b32-95ee-1c67beec9f30]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:06 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 Jul 08 01:34:06 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:07 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64" returned: 0 in 0.968s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-818076e1-4008-4772-a252-337577b0c7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:34:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5652ac7f-d500-4b75-8032-b1e5d73ec874]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:07 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a Jul 08 01:34:07 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:08 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" returned: 0 in 0.974s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-818076e1-4008-4772-a252-337577b0c7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:34:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:08 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 Jul 08 01:34:08 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:09 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64" returned: 0 in 1.255s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:09 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64 Jul 08 01:34:09 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:10 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.6761b8a2-d608-4d1d-af1f-b56d24131d64" returned: 0 in 0.867s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-6761b8a2-d608-4d1d-af1f-b56d24131d64" released by "_delete_snapshot" :: held 4.182s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-818076e1-4008-4772-a252-337577b0c7c0" released by "delete_snapshot" :: held 4.209s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Created reservations ['6e97f8ae-a7e5-4197-9202-0a8ee4fce42a', 'b6f112c6-27d5-4367-9124-947154540f81', '3db0ff04-b31c-4e0b-b36e-7aec7d9850a0', '39ed8586-e8a3-4b39-8a30-63ad71a71168'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Delete snapshot completed successfully. Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-6761b8a2-d608-4d1d-af1f-b56d24131d64-delete_snapshot" released by "delete_snapshot" :: held 4.440s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-818076e1-4008-4772-a252-337577b0c7c0" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-818076e1-4008-4772-a252-337577b0c7c0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Deleting offline snapshot b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a of volume 818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] snapshot_file for this snap is: volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d71dadb-a22c-4298-aa23-ae3c7cb76334]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:10 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a Jul 08 01:34:10 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:11 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" returned: 0 in 1.105s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-818076e1-4008-4772-a252-337577b0c7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:34:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95b7e98-f552-4b35-9fc7-bf2714d0a468]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:11 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 Jul 08 01:34:11 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:12 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0" returned: 0 in 1.102s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:12 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a Jul 08 01:34:12 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:14 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" returned: 0 in 1.306s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:14 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a Jul 08 01:34:14 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:14 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0.b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" returned: 0 in 0.835s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a" released by "_delete_snapshot" :: held 4.527s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-818076e1-4008-4772-a252-337577b0c7c0" released by "delete_snapshot" :: held 4.554s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:15 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Created reservations ['c26a003b-ba4f-49c9-a83a-eebe8d41aa57', '3a49fb73-a9d7-4bc4-b1f7-659b8459558b', '87f5883c-1429-4ca1-a0f0-660e4cddaa39', '97a3a9e5-b9d3-421f-beef-63e2ffee0eae'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Delete snapshot completed successfully. Jul 08 01:34:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-b4b94e5e-273b-46a2-b23c-8d3b5bbd6b4a-delete_snapshot" released by "delete_snapshot" :: held 4.732s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Snapshots deleted, issuing volume delete {{(pid=87204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:34:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-818076e1-4008-4772-a252-337577b0c7c0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-818076e1-4008-4772-a252-337577b0c7c0" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdf4777-3cc2-489d-b4c3-8bdee2c87cea]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:15 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 Jul 08 01:34:15 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:16 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0" returned: 0 in 0.915s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:16 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0 Jul 08 01:34:16 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:16 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-818076e1-4008-4772-a252-337577b0c7c0" returned: 0 in 0.844s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-818076e1-4008-4772-a252-337577b0c7c0" released by "delete_volume" :: held 1.834s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Created reservations ['d35180ff-8f48-4f7b-b2df-ab0f85fa98ec', '82bbb243-92d6-42a9-9e84-c59db6f29c22', '2bcd3cac-4696-4f9d-9ef5-04b91ee008dd', 'becd1fa9-232a-4a1f-b851-4697be170592'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:17 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:34:17 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:17 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.822s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:17 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Deleted volume successfully. Jul 08 01:34:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ce90a31-b7a0-407c-b0d2-e605732396dd tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-818076e1-4008-4772-a252-337577b0c7c0-delete_volume" released by "delete_volume" :: held 12.165s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Flow 'volume_create_manager' (3cdbd7bd-9b83-4ac8-8708-a6d8edab25d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ee7737-6129-4785-a66b-6118abe4b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ee7737-6129-4785-a66b-6118abe4b197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-862848838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53eaea64dd5d4107b119b04ce64b1dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:19Z,use_quota=True,user_id='e8d54cb255764175bdf9e18765162fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed61b13-b043-48c3-8f16-09f75fd0cc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed61b13-b043-48c3-8f16-09f75fd0cc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa814efe-286b-4a31-b8ac-5c4abcf71f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa814efe-286b-4a31-b8ac-5c4abcf71f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55', 'volume_name': 'volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b521d48-f270-4159-ab16-0c800d201f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b521d48-f270-4159-ab16-0c800d201f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26391c34-0e71-44ce-b777-940fbb0cd5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Volume ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55', 'volume_size': 1} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-862848838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53eaea64dd5d4107b119b04ce64b1dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:19Z,use_quota=True,user_id='e8d54cb255764175bdf9e18765162fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Creating volume ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:34:19 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:19 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 1073741824 Jul 08 01:34:19 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:20 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 1073741824" returned: 0 in 1.151s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:20 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 Jul 08 01:34:20 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:21 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" returned: 0 in 1.187s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] <== create_volume: return (2411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:34:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.413s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26391c34-0e71-44ce-b777-940fbb0cd5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b1fbec-4148-4329-9379-5844bccb8130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Volume volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 (ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55): created successfully Jul 08 01:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b1fbec-4148-4329-9379-5844bccb8130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Flow 'volume_create_manager' (3cdbd7bd-9b83-4ac8-8708-a6d8edab25d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ee556e2a-f8e9-4d75-8a6d-ccdd57cc2533 tempest-VolumesDeleteCascade-46065553 None] Created volume successfully. Jul 08 01:34:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Creating offline snapshot e282ad63-753d-4547-8046-e29f265efceb of volume ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:34:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[63af06e0-b22c-4a6a-ae9b-cd2c7601ce39]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:23 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 Jul 08 01:34:23 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:24 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" returned: 0 in 1.217s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:24 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb 1G Jul 08 01:34:24 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6aa104f5-4ff9-4f46-ac93-a90ca5aadf5d tempest-VolumesActionsTest-399751391 None] Acquiring lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" by "attach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6aa104f5-4ff9-4f46-ac93-a90ca5aadf5d tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" acquired by "attach_volume" :: waited 0.044s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6aa104f5-4ff9-4f46-ac93-a90ca5aadf5d tempest-VolumesActionsTest-399751391 None] Attaching volume 22e342a2-d1cb-42c3-80f6-5291c12a5ac8 to instance c8fd4a90-b99a-4c7b-b762-409b87a2ba32 at mountpoint /dev/vdb on host None. Jul 08 01:34:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6aa104f5-4ff9-4f46-ac93-a90ca5aadf5d tempest-VolumesActionsTest-399751391 None] Attach volume completed successfully. Jul 08 01:34:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6aa104f5-4ff9-4f46-ac93-a90ca5aadf5d tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" released by "attach_volume" :: held 0.209s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:25 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb 1G" returned: 0 in 1.298s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:25 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb Jul 08 01:34:25 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cadff4f2-5343-404f-a8b8-176df0f56d6a tempest-VolumesActionsTest-399751391 None] Acquiring lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8-detach_volume" by "detach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cadff4f2-5343-404f-a8b8-176df0f56d6a tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cadff4f2-5343-404f-a8b8-176df0f56d6a tempest-VolumesActionsTest-399751391 None] Detaching volume 22e342a2-d1cb-42c3-80f6-5291c12a5ac8 from instance c8fd4a90-b99a-4c7b-b762-409b87a2ba32. Jul 08 01:34:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cadff4f2-5343-404f-a8b8-176df0f56d6a tempest-VolumesActionsTest-399751391 None] Detach volume completed successfully. Jul 08 01:34:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cadff4f2-5343-404f-a8b8-176df0f56d6a tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:26 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb" returned: 0 in 0.926s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:26 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb is being set with open permissions: ugo+rw Jul 08 01:34:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:26 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb Jul 08 01:34:26 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:27 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb" returned: 0 in 1.145s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:27 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=111,cinder:SELECT=83,cinder:INSERT=34,cinder:DELETE=14 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:34:27 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=113,cinder:SELECT=102,cinder:INSERT=23,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:34:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:27 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.info Jul 08 01:34:27 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:28 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.info" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:28 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.info is being set with open permissions: ugo+rw Jul 08 01:34:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:28 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.info Jul 08 01:34:28 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:29 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.info" returned: 0 in 0.880s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.520s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4510d8ed-5e36-49f2-bd43-e5ee65d9fb2e tempest-VolumesDeleteCascade-46065553 None] Create snapshot completed successfully Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Flow 'volume_create_manager' (82de10a7-5415-47a6-857d-4bc083b16b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9683176d-9cdf-46b7-9e88-92e38b6d9317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9683176d-9cdf-46b7-9e88-92e38b6d9317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-378805432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a01bf52-11c2-4fe1-aa4a-06198cc16f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53eaea64dd5d4107b119b04ce64b1dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e282ad63-753d-4547-8046-e29f265efceb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:31Z,use_quota=True,user_id='e8d54cb255764175bdf9e18765162fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae86d26-0414-4e18-a41b-11b2c59b58bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae86d26-0414-4e18-a41b-11b2c59b58bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d8c4a9-1429-4b79-ae6e-17dc7a98a4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d8c4a9-1429-4b79-ae6e-17dc7a98a4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a01bf52-11c2-4fe1-aa4a-06198cc16f75', 'volume_name': 'volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75', 'volume_size': 1, 'snapshot_id': 'e282ad63-753d-4547-8046-e29f265efceb'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34516fb-922d-45fa-850e-dc7532d9112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34516fb-922d-45fa-850e-dc7532d9112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b821c0f0-8616-4ee5-86a3-06e35efb9595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Volume 3a01bf52-11c2-4fe1-aa4a-06198cc16f75: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75', 'volume_size': 1, 'snapshot_id': 'e282ad63-753d-4547-8046-e29f265efceb'} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-e282ad63-753d-4547-8046-e29f265efceb-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-e282ad63-753d-4547-8046-e29f265efceb-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Creating volume 3a01bf52-11c2-4fe1-aa4a-06198cc16f75 from snapshot e282ad63-753d-4547-8046-e29f265efceb {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] snapshot: e282ad63-753d-4547-8046-e29f265efceb, volume: 3a01bf52-11c2-4fe1-aa4a-06198cc16f75, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f287e1-95c8-42cd-8bdd-f1202f4760fd]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:31 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb Jul 08 01:34:31 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Flow 'volume_create_manager' (d0922f12-98fb-454e-acb1-88ef419d5b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3fe7c8-70cf-47bf-b90c-072ee46ba3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3fe7c8-70cf-47bf-b90c-072ee46ba3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1358199603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f96e6733f2c474f85528457f23227c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:32Z,use_quota=True,user_id='9955da4d9eff448bad3629a0dd1c77e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1eeb85-7850-49ea-988a-dd2698b131cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1eeb85-7850-49ea-988a-dd2698b131cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9643193-c115-4f06-a5b8-2d0506e54df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9643193-c115-4f06-a5b8-2d0506e54df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8', 'volume_name': 'volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec943e7-222a-4397-8696-fef76fdea2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:32 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec943e7-222a-4397-8696-fef76fdea2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c337dbf6-3fa2-4bd5-ae38-75f0508ab105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Volume bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8', 'volume_size': 1} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb" returned: 0 in 1.000s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1a931c-c139-4e0e-8b5b-7e2cc1dcd20f]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:32 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 Jul 08 01:34:32 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:33 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" returned: 0 in 0.995s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:33 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:34:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:33 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 Jul 08 01:34:33 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" returned: 0 in 5.921s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1624f46-6b77-4418-8dcc-23d949a46c42]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:39 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 Jul 08 01:34:39 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:40 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" returned: 0 in 1.177s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:40 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:34:40 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Converted 1024.00 MB image at 172.90 MB/s Jul 08 01:34:40 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 is being set with open permissions: ugo+rw Jul 08 01:34:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:40 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 Jul 08 01:34:40 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:41 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" returned: 0 in 0.717s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" released by "_copy_volume_from_snapshot" :: held 9.972s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-e282ad63-753d-4547-8046-e29f265efceb-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" released by "_create_volume_from_snapshot" :: held 10.006s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.026s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.892s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1358199603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f96e6733f2c474f85528457f23227c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:32Z,use_quota=True,user_id='9955da4d9eff448bad3629a0dd1c77e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Creating volume bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:34:41 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:41 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 1073741824 Jul 08 01:34:41 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b821c0f0-8616-4ee5-86a3-06e35efb9595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75', 'volume_size': 1, 'snapshot_id': 'e282ad63-753d-4547-8046-e29f265efceb'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2f7476-d186-4163-8b7f-50389dbd9e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Volume volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 (3a01bf52-11c2-4fe1-aa4a-06198cc16f75): created successfully Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2f7476-d186-4163-8b7f-50389dbd9e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Flow 'volume_create_manager' (82de10a7-5415-47a6-857d-4bc083b16b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5c29a03d-d29f-403a-94c0-6d9c2396c249 tempest-VolumesDeleteCascade-46065553 None] Created volume successfully. Jul 08 01:34:42 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 1073741824" returned: 0 in 0.907s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:42 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 Jul 08 01:34:42 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Performing cascade delete. {{(pid=87204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-e282ad63-753d-4547-8046-e29f265efceb-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-e282ad63-753d-4547-8046-e29f265efceb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-e282ad63-753d-4547-8046-e29f265efceb" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-e282ad63-753d-4547-8046-e29f265efceb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Deleting offline snapshot e282ad63-753d-4547-8046-e29f265efceb of volume ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] snapshot_file for this snap is: volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ed5547-29ed-4636-bbd1-d44b24bd3bfb]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:42 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb Jul 08 01:34:42 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:42 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.533s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c337dbf6-3fa2-4bd5-ae38-75f0508ab105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8937e18-846a-494b-9b08-4b37f25d93bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff78a1f-6e43-4cdf-8090-40b1d1bea9e8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Volume volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 (bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8): created successfully Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8937e18-846a-494b-9b08-4b37f25d93bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Flow 'volume_create_manager' (d0922f12-98fb-454e-acb1-88ef419d5b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a0906032-76c0-40c7-a4e5-e3bdf9d6da40 tempest-TestStampPattern-261008118 None] Created volume successfully. Jul 08 01:34:43 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 Jul 08 01:34:43 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:43 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb" returned: 0 in 0.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be844af-7e25-4f94-b6db-d43a3d05292d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:43 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 Jul 08 01:34:43 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:43 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" returned: 0 in 0.945s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[53433b19-4cf5-46fc-a7d9-7c7d0844292f]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:44 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 Jul 08 01:34:44 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:44 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" returned: 0 in 1.058s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:44 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb Jul 08 01:34:44 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:45 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" returned: 0 in 1.166s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.694948f8-29a4-4eb2-976b-4afa496bae036nnu003j.img {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:45 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.694948f8-29a4-4eb2-976b-4afa496bae036nnu003j.img Jul 08 01:34:45 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:45 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb" returned: 0 in 1.001s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:45 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb Jul 08 01:34:45 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:47 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55.e282ad63-753d-4547-8046-e29f265efceb" returned: 0 in 1.825s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-e282ad63-753d-4547-8046-e29f265efceb" released by "_delete_snapshot" :: held 4.915s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" released by "delete_snapshot" :: held 4.950s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Created reservations ['8258d0ef-30f4-41d0-a66e-350f813172c6', 'b1d5a3fa-f6ba-4dfc-962f-2a7fa6311af1', '9eb391a9-6a5d-4c60-8d26-b8a5edc5dcf5', 'bac26676-8ab7-4d1b-b0cb-47c93565c77e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Delete snapshot completed successfully. Jul 08 01:34:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-e282ad63-753d-4547-8046-e29f265efceb-delete_snapshot" released by "delete_snapshot" :: held 5.383s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Snapshots deleted, issuing volume delete {{(pid=87204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:34:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" acquired by "delete_volume" :: waited 0.073s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[177b8531-9be5-4a48-81a4-cef401ef95c4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:48 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 Jul 08 01:34:48 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:50 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" returned: 0 in 1.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:50 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55 Jul 08 01:34:50 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:52 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" returned: 0 in 2.290s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55" released by "delete_volume" :: held 4.408s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:52 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.694948f8-29a4-4eb2-976b-4afa496bae036nnu003j.img" returned: 0 in 7.292s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Created reservations ['a208c40f-f1c1-4d00-ac35-265ca62d43ab', 'c337805d-a6cf-40ad-b531-00a99364fd9f', 'a94dd1a8-4bf0-4657-97d3-dd01f68dae82', '16d919ab-f95f-4056-b8dc-f7bcb4d2e088'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a179a6e0-7d1f-4fd1-9d59-efac5ed91d9c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:52 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 Jul 08 01:34:52 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:52 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:34:52 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-3a01bf52-11c2-4fe1-aa4a-06198cc16f75-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-3a01bf52-11c2-4fe1-aa4a-06198cc16f75-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "cinder-quobyte-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[966828b2-2ecd-478e-9a22-118b297c2d25]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:53 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:34:53 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:53 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 Jul 08 01:34:53 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:53 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.170s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Deleted volume successfully. Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb492cb5-7008-4aac-927b-11129202af93 tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-ed3c2a7a-0bc9-46a5-85c5-03dec47ffd55-delete_volume" released by "delete_volume" :: held 11.389s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:53 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" returned: 0 in 1.524s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:53 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8, size 1024.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.694948f8-29a4-4eb2-976b-4afa496bae036nnu003j.img {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:34:53 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Converted 1024.00 MB image at 140.40 MB/s Jul 08 01:34:54 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] 694948f8-29a4-4eb2-976b-4afa496bae03 was raw, no need to convert to raw {{(pid=87204) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 01:34:54 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.127s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:34:54 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" returned: 0 in 1.376s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:54 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75 Jul 08 01:34:54 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:55 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" returned: 0 in 0.989s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-quobyte-3a01bf52-11c2-4fe1-aa4a-06198cc16f75" released by "delete_volume" :: held 2.436s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Created reservations ['6c5a6033-36b4-4bd8-a8bd-04766556eefc', '77f6817d-d883-4ae2-a27e-34fca6e0336e', '36f21451-0e36-4649-a057-80d972831c5b', 'ab9d49f4-a59f-45c6-a52e-e6fce3092e98'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:56 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:34:56 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:57 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.124s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:57 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Deleted volume successfully. Jul 08 01:34:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0b4c4f89-36e1-461a-8c02-11b924db49ca tempest-VolumesDeleteCascade-46065553 None] Lock "cinder-3a01bf52-11c2-4fe1-aa4a-06198cc16f75-delete_volume" released by "delete_volume" :: held 3.896s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Flow 'volume_create_manager' (4749b3d8-5e47-435d-a6dc-5eb28b85bd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb6cceb-e69c-4f4a-8724-76d84ab0d9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb6cceb-e69c-4f4a-8724-76d84ab0d9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-540759764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2437164-1541-4695-a5f5-c43fc25437d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4796dc7d4b74f85a886d6f781b4d7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:03Z,use_quota=True,user_id='df386a7756e043429b0c3125d0d2c170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225aefcf-e718-4f54-818e-ca0b6892591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225aefcf-e718-4f54-818e-ca0b6892591d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0516d960-84fd-4371-be64-9efb1e4a6550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0516d960-84fd-4371-be64-9efb1e4a6550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2437164-1541-4695-a5f5-c43fc25437d0', 'volume_name': 'volume-d2437164-1541-4695-a5f5-c43fc25437d0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60b4d8a-f12e-42a7-8869-3da2455a5ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60b4d8a-f12e-42a7-8869-3da2455a5ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8eb03f7-a5d3-47ca-9c55-25efefe250c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Volume d2437164-1541-4695-a5f5-c43fc25437d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2437164-1541-4695-a5f5-c43fc25437d0', 'volume_size': 1} Jul 08 01:35:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:12 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=31,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:35:12 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=25,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.799s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Uploaded volume to glance image-id: 694948f8-29a4-4eb2-976b-4afa496bae03. {{(pid=87204) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.776s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-540759764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2437164-1541-4695-a5f5-c43fc25437d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4796dc7d4b74f85a886d6f781b4d7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:03Z,use_quota=True,user_id='df386a7756e043429b0c3125d0d2c170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Creating volume d2437164-1541-4695-a5f5-c43fc25437d0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:15 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:35:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:15 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0 1073741824 Jul 08 01:35:15 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eabd2c88-c103-4091-9087-133fa73329b8 tempest-VolumesActionsTest-399751391 None] Copy volume to image completed successfully. Jul 08 01:35:16 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0 1073741824" returned: 0 in 0.943s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:16 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0 Jul 08 01:35:16 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:17 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0" returned: 0 in 0.700s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.024s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8eb03f7-a5d3-47ca-9c55-25efefe250c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2437164-1541-4695-a5f5-c43fc25437d0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f119ab81-6ce6-4db4-a4c2-f4291b0dc936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc94041c-45b8-4a70-9b69-1fdc4989fcb4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Volume volume-d2437164-1541-4695-a5f5-c43fc25437d0 (d2437164-1541-4695-a5f5-c43fc25437d0): created successfully Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f119ab81-6ce6-4db4-a4c2-f4291b0dc936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Flow 'volume_create_manager' (4749b3d8-5e47-435d-a6dc-5eb28b85bd37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-749a19ee-4ec2-4d82-8905-5919104407a3 tempest-VolumesTransfersTest-669544671 None] Created volume successfully. Jul 08 01:35:17 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 Jul 08 01:35:17 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:18 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c46cfa-158c-4fea-855c-d3e0ee9e8921]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:18 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 Jul 08 01:35:18 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-386b4053-8221-4074-8898-eb07a6af51db tempest-VolumesTransfersTest-2085968254 None] Transfer volume completed successfully. Jul 08 01:35:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-81d37477-3d1c-495c-9ab7-cc0b8c82fb4d req-1d134b16-7b5f-4f1a-89c7-d335be5beb02 tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:19 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" returned: 0 in 0.793s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:19 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img Jul 08 01:35:19 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Acquiring lock "cinder-d2437164-1541-4695-a5f5-c43fc25437d0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Lock "cinder-d2437164-1541-4695-a5f5-c43fc25437d0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Acquiring lock "cinder-quobyte-d2437164-1541-4695-a5f5-c43fc25437d0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Lock "cinder-quobyte-d2437164-1541-4695-a5f5-c43fc25437d0" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb1f4b1-372c-493b-8657-cb2e457e2ddd]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:20 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0 Jul 08 01:35:20 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:22 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0" returned: 0 in 2.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:22 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0 Jul 08 01:35:22 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:24 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2437164-1541-4695-a5f5-c43fc25437d0" returned: 0 in 1.514s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Lock "cinder-quobyte-d2437164-1541-4695-a5f5-c43fc25437d0" released by "delete_volume" :: held 4.412s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:24 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img" returned: 0 in 5.090s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62fed0b-d453-41e6-a741-4caae3b59933]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Created reservations ['471de359-77f0-4e65-a189-b26adc6a1b3e', '58a42540-9256-4039-ae75-707b01aa4e1f', '03df667d-eedd-4ea5-b14b-46556665b342', 'f569f792-1fa8-4536-9c39-029ac8fd3466'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:24 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 Jul 08 01:35:24 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:24 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:35:24 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:25 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.715s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Deleted volume successfully. Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c3a713f-3796-42fd-b129-103ce6d28a74 tempest-VolumesTransfersTest-1008292155 None] Lock "cinder-d2437164-1541-4695-a5f5-c43fc25437d0-delete_volume" released by "delete_volume" :: held 5.390s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:25 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Flow 'volume_create_manager' (91e191df-4669-43d9-b438-35e98f5ad504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d306a9-6716-4c7e-97f3-38b27014024c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" returned: 0 in 0.999s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:35:25 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Converted 1024.00 MB image at 201.13 MB/s Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d306a9-6716-4c7e-97f3-38b27014024c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-830612066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61f9229-628d-4589-97b6-2645ce61a62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4796dc7d4b74f85a886d6f781b4d7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:25Z,use_quota=True,user_id='df386a7756e043429b0c3125d0d2c170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a3c4b0-62ce-4ca0-86c1-e727feed0d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a3c4b0-62ce-4ca0-86c1-e727feed0d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa60cf3-d5a2-4b7a-9570-9c38957cdbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa60cf3-d5a2-4b7a-9570-9c38957cdbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61f9229-628d-4589-97b6-2645ce61a62d', 'volume_name': 'volume-a61f9229-628d-4589-97b6-2645ce61a62d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caeb8776-069a-43f9-a19b-0b306515213e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caeb8776-069a-43f9-a19b-0b306515213e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cced0732-1f0c-4c35-b5f6-327629e8c1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Volume a61f9229-628d-4589-97b6-2645ce61a62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61f9229-628d-4589-97b6-2645ce61a62d', 'volume_size': 1} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] e8b53b63-7e87-4988-aeab-3cb60be644df was raw, converting to qcow2 {{(pid=87204) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8970d9ca-e374-4bbd-9db2-d02e3509c3da]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:25 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img Jul 08 01:35:25 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:26 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:26 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img Jul 08 01:35:26 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:26 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img" returned: 1 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:35:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img /opt/stack/data/cinder/conversion/vol_upload_fsel4zck {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:26 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img /opt/stack/data/cinder/conversion/vol_upload_fsel4zck Jul 08 01:35:26 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:27 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img /opt/stack/data/cinder/conversion/vol_upload_fsel4zck" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:27 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Image conversion details: src /opt/stack/data/cinder/conversion/22e342a2-d1cb-42c3-80f6-5291c12a5ac8.temp_image.e8b53b63-7e87-4988-aeab-3cb60be644dfy_nzfdor.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fsel4zck {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:35:27 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 01:35:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd6d16f-6abb-4fc1-b0be-f728beed40e3]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fsel4zck {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:27 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fsel4zck Jul 08 01:35:27 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:28 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fsel4zck" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.349s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Uploaded volume to glance image-id: e8b53b63-7e87-4988-aeab-3cb60be644df. {{(pid=87204) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:35:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-81d37477-3d1c-495c-9ab7-cc0b8c82fb4d req-1d134b16-7b5f-4f1a-89c7-d335be5beb02 tempest-TestStampPattern-261008118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.906s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b13cbc-4af7-4520-b828-26c24dfb9d27]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-81d37477-3d1c-495c-9ab7-cc0b8c82fb4d req-1d134b16-7b5f-4f1a-89c7-d335be5beb02 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-37fd3b03-7958-4e9e-8f67-1138d442a961 tempest-VolumesActionsTest-399751391 None] Copy volume to image completed successfully. Jul 08 01:35:29 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 Jul 08 01:35:29 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:30 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-81d37477-3d1c-495c-9ab7-cc0b8c82fb4d req-1d134b16-7b5f-4f1a-89c7-d335be5beb02 tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-81d37477-3d1c-495c-9ab7-cc0b8c82fb4d req-1d134b16-7b5f-4f1a-89c7-d335be5beb02 tempest-TestStampPattern-261008118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.928s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.453s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-830612066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61f9229-628d-4589-97b6-2645ce61a62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4796dc7d4b74f85a886d6f781b4d7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:25Z,use_quota=True,user_id='df386a7756e043429b0c3125d0d2c170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Creating volume a61f9229-628d-4589-97b6-2645ce61a62d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:30 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:30 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d 1073741824 Jul 08 01:35:30 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-81d37477-3d1c-495c-9ab7-cc0b8c82fb4d req-1d134b16-7b5f-4f1a-89c7-d335be5beb02 tempest-TestStampPattern-261008118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80481a2f-4581-435e-97fa-0f6b4e30da97', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:35:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-81d37477-3d1c-495c-9ab7-cc0b8c82fb4d req-1d134b16-7b5f-4f1a-89c7-d335be5beb02 tempest-TestStampPattern-261008118 None] attachment_update completed successfully. Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Acquiring lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Acquiring lock "cinder-quobyte-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Lock "cinder-quobyte-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb2d7c5-e34a-44cd-bea0-09b6cef3167e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:31 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 Jul 08 01:35:31 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:31 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d 1073741824" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:31 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d Jul 08 01:35:31 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:32 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" returned: 0 in 1.024s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:32 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8 Jul 08 01:35:32 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:32 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d" returned: 0 in 0.870s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cced0732-1f0c-4c35-b5f6-327629e8c1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61f9229-628d-4589-97b6-2645ce61a62d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60970d3e-83db-4e7c-9b92-96525c7bef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Volume volume-a61f9229-628d-4589-97b6-2645ce61a62d (a61f9229-628d-4589-97b6-2645ce61a62d): created successfully Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60970d3e-83db-4e7c-9b92-96525c7bef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Flow 'volume_create_manager' (91e191df-4669-43d9-b438-35e98f5ad504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3fcfdc85-9e5c-4c28-99c0-8fdb1b9c7c50 tempest-VolumesTransfersTest-669544671 None] Created volume successfully. Jul 08 01:35:32 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Lock "cinder-quobyte-22e342a2-d1cb-42c3-80f6-5291c12a5ac8" released by "delete_volume" :: held 1.834s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Created reservations ['79fed6a9-0fce-477b-a5ab-914428d13c6d', 'bf986612-bec6-4b17-8c11-afd6d803df00', '2cbdc68a-87d6-40cd-8b09-25101729cb2d', 'f410f9f8-fda2-4187-8673-92f4b6e0d713'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:32 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:35:32 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:33 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:33 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Deleted volume successfully. Jul 08 01:35:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b30f0b50-f7b5-4859-a6e9-b6f7978b91e9 tempest-VolumesActionsTest-399751391 None] Lock "cinder-22e342a2-d1cb-42c3-80f6-5291c12a5ac8-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Acquiring lock "cinder-a61f9229-628d-4589-97b6-2645ce61a62d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Lock "cinder-a61f9229-628d-4589-97b6-2645ce61a62d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Acquiring lock "cinder-quobyte-a61f9229-628d-4589-97b6-2645ce61a62d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Lock "cinder-quobyte-a61f9229-628d-4589-97b6-2645ce61a62d" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[81243250-5721-4f28-aafb-1621d503eca5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:34 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d Jul 08 01:35:34 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:35 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d" returned: 0 in 0.875s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:35 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d Jul 08 01:35:35 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:35 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a61f9229-628d-4589-97b6-2645ce61a62d" returned: 0 in 0.714s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Lock "cinder-quobyte-a61f9229-628d-4589-97b6-2645ce61a62d" released by "delete_volume" :: held 1.639s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Created reservations ['083e4712-89c0-48fe-9078-93f42a2a6260', 'afe1e0b8-9488-47b9-ae2d-eb8999da8fa6', '5aa2b210-cdb9-41c3-8b9d-56bc4fe28500', '8e91db74-468c-4e13-9490-b6b01e68bae2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:36 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:35:36 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:36 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:36 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Deleted volume successfully. Jul 08 01:35:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1318fc82-cf6e-4bec-bc09-0b59f2d54986 tempest-VolumesTransfersTest-1008292155 None] Lock "cinder-a61f9229-628d-4589-97b6-2645ce61a62d-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-f8655f0f-b81f-419a-ae5f-501bac92693e req-aa6fe80f-9072-42b2-bbb5-6da1242f16c2 tempest-TestStampPattern-261008118 None] Terminate volume connection completed successfully. Jul 08 01:35:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-f8655f0f-b81f-419a-ae5f-501bac92693e req-aa6fe80f-9072-42b2-bbb5-6da1242f16c2 tempest-TestStampPattern-261008118 None] Deleting attachment 80481a2f-4581-435e-97fa-0f6b4e30da97. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Flow 'volume_create_manager' (cfe134c0-88c2-4f25-83aa-e8b8573cda5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5162229-9887-439d-9d09-4dc44ea7d9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5162229-9887-439d-9d09-4dc44ea7d9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1622065887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a0a563-684e-40ed-9d54-e1a35e85804d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10839cbd0d245eea9bf1bb581613938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:41Z,use_quota=True,user_id='59aba26f888d4fb3ba986aff03068ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4c3ef9-ba84-44e2-94bd-bf9217124aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4c3ef9-ba84-44e2-94bd-bf9217124aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668a9373-86d2-4f04-aab2-f726a3752709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668a9373-86d2-4f04-aab2-f726a3752709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8a0a563-684e-40ed-9d54-e1a35e85804d', 'volume_name': 'volume-c8a0a563-684e-40ed-9d54-e1a35e85804d', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79dd27d-cc2f-4b05-b94f-3f1df6e09171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79dd27d-cc2f-4b05-b94f-3f1df6e09171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4340f2b-0f14-4c56-9920-9f7adc1cac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Volume c8a0a563-684e-40ed-9d54-e1a35e85804d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8a0a563-684e-40ed-9d54-e1a35e85804d', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:35:41 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Trying to clone c8a0a563-684e-40ed-9d54-e1a35e85804d from image 32b92798-e800-4287-a1ac-3d0d0779a37d at location (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:35:42 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:35:42 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:35:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f05b705-68ec-403a-a16f-3251fed3a0b1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:42 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD Jul 08 01:35:42 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Creating offline snapshot a9267f56-fb95-4fc1-bd34-6e68d06f8b56 of volume bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c19b90-0de1-48e4-910d-8caa8a879732]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:43 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD" returned: 0 in 0.959s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Temporary image 32b92798-e800-4287-a1ac-3d0d0779a37d is fetched for user 59aba26f888d4fb3ba986aff03068ac8. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cce2015-7f69-4344-918a-2f43ab70bd1c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:43 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 Jul 08 01:35:43 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:43 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD Jul 08 01:35:43 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Flow 'volume_create_manager' (96320816-323e-48be-9097-fefa9db95f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f67cf69-1be8-44ee-9b23-c996f6cd9688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f67cf69-1be8-44ee-9b23-c996f6cd9688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-300019426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561f9b87-3b1f-4b0a-9689-bb42dbde3539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cabb9fd5d7410e8b60d5e65b33fdf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:44Z,use_quota=True,user_id='c3db33a45bf249ba88082021a528c8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea5ade6-ab55-4df5-b46c-d422f57d0bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea5ade6-ab55-4df5-b46c-d422f57d0bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0607d037-bd2d-4239-b4ee-e37a27aaf63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0607d037-bd2d-4239-b4ee-e37a27aaf63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561f9b87-3b1f-4b0a-9689-bb42dbde3539', 'volume_name': 'volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f745cfd-bcff-47e1-84d2-078427adac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f745cfd-bcff-47e1-84d2-078427adac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4dca6f7-6978-4cb9-a6f3-6eb6d16c8cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Volume 561f9b87-3b1f-4b0a-9689-bb42dbde3539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539', 'volume_size': 1} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:43 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:43 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 1G Jul 08 01:35:43 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:44 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD" returned: 0 in 0.881s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:44 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 1G" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:44 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 Jul 08 01:35:44 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:45 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:45 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 is being set with open permissions: ugo+rw Jul 08 01:35:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:45 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 Jul 08 01:35:45 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:46 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56" returned: 0 in 0.677s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:46 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.info Jul 08 01:35:46 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:46 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.info" returned: 0 in 0.708s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:46 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.info is being set with open permissions: ugo+rw Jul 08 01:35:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:46 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.info Jul 08 01:35:46 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:47 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.info" returned: 0 in 0.666s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.601s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.828s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-300019426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561f9b87-3b1f-4b0a-9689-bb42dbde3539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cabb9fd5d7410e8b60d5e65b33fdf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:44Z,use_quota=True,user_id='c3db33a45bf249ba88082021a528c8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Creating volume 561f9b87-3b1f-4b0a-9689-bb42dbde3539 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:47 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:47 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 1073741824 Jul 08 01:35:47 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ffec7eb2-573e-404d-9e9e-8fa68bf027d3 tempest-TestStampPattern-261008118 None] Create snapshot completed successfully Jul 08 01:35:48 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 1073741824" returned: 0 in 0.926s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:48 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 Jul 08 01:35:48 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:49 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539" returned: 0 in 0.716s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.263s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1622065887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a0a563-684e-40ed-9d54-e1a35e85804d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10839cbd0d245eea9bf1bb581613938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:41Z,use_quota=True,user_id='59aba26f888d4fb3ba986aff03068ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Creating volume c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:49 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4dca6f7-6978-4cb9-a6f3-6eb6d16c8cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:49 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d 1073741824 Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7655289c-88f6-4c92-9306-23f4fc750bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:49 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Volume volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 (561f9b87-3b1f-4b0a-9689-bb42dbde3539): created successfully Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7655289c-88f6-4c92-9306-23f4fc750bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Flow 'volume_create_manager' (96320816-323e-48be-9097-fefa9db95f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-646d92d8-0e0e-46fc-b1a3-f9118db30747 tempest-VolumesNegativeTest-727355574 None] Created volume successfully. Jul 08 01:35:50 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d 1073741824" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:50 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d Jul 08 01:35:50 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:50 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d" returned: 0 in 0.738s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Attempting download of 32b92798-e800-4287-a1ac-3d0d0779a37d ((None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}])) to volume c8a0a563-684e-40ed-9d54-e1a35e85804d. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:35:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c762c1-16b0-423f-b33f-0a4bfd0980ee]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_pien9t2a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:51 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_pien9t2a Jul 08 01:35:51 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:51 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_pien9t2a" returned: 0 in 0.804s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_pien9t2a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:51 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_pien9t2a Jul 08 01:35:51 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:52 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_pien9t2a" returned: 1 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_pien9t2a' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:35:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86accc0-d514-4ccc-a2e7-86d679f29213]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:52 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD Jul 08 01:35:52 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:53 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD" returned: 0 in 0.801s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] 32b92798-e800-4287-a1ac-3d0d0779a37d was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:53 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d Jul 08 01:35:53 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:53 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:35:53 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:54 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:35:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:35:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:35:55 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d" returned: 0 in 2.452s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:55 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_22lv9x__devstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:35:55 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Converted 112.00 MB image at 45.66 MB/s Jul 08 01:35:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:55 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d 1G Jul 08 01:35:55 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:57 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d 1G" returned: 0 in 1.080s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dbd973-d786-4ef0-bff2-dc23f87bcef1]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:57 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d Jul 08 01:35:57 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:58 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d" returned: 0 in 1.118s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:58 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d Jul 08 01:35:58 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:59 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d" returned: 1 in 0.868s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Downloaded image 32b92798-e800-4287-a1ac-3d0d0779a37d ((None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}])) to volume c8a0a563-684e-40ed-9d54-e1a35e85804d successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Temporary image 32b92798-e800-4287-a1ac-3d0d0779a37d for user 59aba26f888d4fb3ba986aff03068ac8 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Marking volume c8a0a563-684e-40ed-9d54-e1a35e85804d as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Copying metadata from image 32b92798-e800-4287-a1ac-3d0d0779a37d to c8a0a563-684e-40ed-9d54-e1a35e85804d. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Creating volume glance metadata for volume c8a0a563-684e-40ed-9d54-e1a35e85804d backed by image 32b92798-e800-4287-a1ac-3d0d0779a37d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4340f2b-0f14-4c56-9920-9f7adc1cac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a0a563-684e-40ed-9d54-e1a35e85804d', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20acd9e-55c5-483c-9c91-a1d1ffcced65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Volume volume-c8a0a563-684e-40ed-9d54-e1a35e85804d (c8a0a563-684e-40ed-9d54-e1a35e85804d): created successfully Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20acd9e-55c5-483c-9c91-a1d1ffcced65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Flow 'volume_create_manager' (cfe134c0-88c2-4f25-83aa-e8b8573cda5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7503cb0e-0da9-4597-95f1-412030a340bb tempest-VolumesExtendTest-1643540082 None] Created volume successfully. Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Flow 'volume_create_manager' (87c813c8-98a0-4826-9ff5-656a96d00068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a8cddc-21a6-4447-8609-ce351fc13576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a8cddc-21a6-4447-8609-ce351fc13576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-199016995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492cb668-e25c-4d41-bb45-791905bda4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f96e6733f2c474f85528457f23227c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9267f56-fb95-4fc1-bd34-6e68d06f8b56,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:59Z,use_quota=True,user_id='9955da4d9eff448bad3629a0dd1c77e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c007f482-6ef1-4600-ae2a-67b5f0a4a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c007f482-6ef1-4600-ae2a-67b5f0a4a378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf638ba-cee2-451b-8460-f79775d45718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf638ba-cee2-451b-8460-f79775d45718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '492cb668-e25c-4d41-bb45-791905bda4ba', 'volume_name': 'volume-492cb668-e25c-4d41-bb45-791905bda4ba', 'volume_size': 1, 'snapshot_id': 'a9267f56-fb95-4fc1-bd34-6e68d06f8b56'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13906392-9dca-4716-97b6-55947292741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13906392-9dca-4716-97b6-55947292741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84997cc3-dd3c-43fb-ac03-0cc62bcef336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Volume 492cb668-e25c-4d41-bb45-791905bda4ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-492cb668-e25c-4d41-bb45-791905bda4ba', 'volume_size': 1, 'snapshot_id': 'a9267f56-fb95-4fc1-bd34-6e68d06f8b56'} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Acquiring lock "cinder-quobyte-a9267f56-fb95-4fc1-bd34-6e68d06f8b56-492cb668-e25c-4d41-bb45-791905bda4ba" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-a9267f56-fb95-4fc1-bd34-6e68d06f8b56-492cb668-e25c-4d41-bb45-791905bda4ba" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Creating volume 492cb668-e25c-4d41-bb45-791905bda4ba from snapshot a9267f56-fb95-4fc1-bd34-6e68d06f8b56 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Acquiring lock "cinder-quobyte-492cb668-e25c-4d41-bb45-791905bda4ba" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-492cb668-e25c-4d41-bb45-791905bda4ba" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] snapshot: a9267f56-fb95-4fc1-bd34-6e68d06f8b56, volume: 492cb668-e25c-4d41-bb45-791905bda4ba, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e2dace-1968-439f-a67b-5f38dc3629ff]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:59 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 Jul 08 01:35:59 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:00 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:36:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:36:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[00751e36-1e8d-414b-95b5-50c9552bc319]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:00 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 Jul 08 01:36:00 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:01 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" returned: 0 in 0.987s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:01 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:36:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:01 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba Jul 08 01:36:01 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:09 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=50,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=15 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:36:09 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=46,cinder:SELECT=40,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:36:09 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba" returned: 0 in 8.207s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dc0d65-5155-4236-b7fd-0e1baba1a36e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:10 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 Jul 08 01:36:10 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:11 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" returned: 0 in 1.602s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:11 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:36:11 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Converted 1024.00 MB image at 124.75 MB/s Jul 08 01:36:11 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba is being set with open permissions: ugo+rw Jul 08 01:36:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:11 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba Jul 08 01:36:11 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:12 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba" returned: 0 in 1.040s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-492cb668-e25c-4d41-bb45-791905bda4ba" released by "_copy_volume_from_snapshot" :: held 12.969s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-a9267f56-fb95-4fc1-bd34-6e68d06f8b56-492cb668-e25c-4d41-bb45-791905bda4ba" released by "_create_volume_from_snapshot" :: held 13.021s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.040s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 12.928s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26c98af-c537-4818-96ef-af4cad8f9fca]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84997cc3-dd3c-43fb-ac03-0cc62bcef336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492cb668-e25c-4d41-bb45-791905bda4ba', 'volume_size': 1, 'snapshot_id': 'a9267f56-fb95-4fc1-bd34-6e68d06f8b56'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edba5ef-1716-4900-a05d-206b6a3cf1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Volume volume-492cb668-e25c-4d41-bb45-791905bda4ba (492cb668-e25c-4d41-bb45-791905bda4ba): created successfully Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edba5ef-1716-4900-a05d-206b6a3cf1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Flow 'volume_create_manager' (87c813c8-98a0-4826-9ff5-656a96d00068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6f0fe297-2243-4460-b07e-a22abf2aa41b tempest-TestStampPattern-261008118 None] Created volume successfully. Jul 08 01:36:12 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d Jul 08 01:36:12 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:13 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d" returned: 0 in 0.926s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:13 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d Jul 08 01:36:13 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:14 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d" returned: 1 in 0.887s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:36:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d 2G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d 2G" returned: 0 in 0.067s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.988s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ed0dfcd6-168a-4493-9bd7-5275d1fe8628 tempest-VolumesExtendTest-1643540082 None] Extend volume completed successfully. Jul 08 01:36:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "cinder-c8a0a563-684e-40ed-9d54-e1a35e85804d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-c8a0a563-684e-40ed-9d54-e1a35e85804d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "cinder-quobyte-c8a0a563-684e-40ed-9d54-e1a35e85804d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-quobyte-c8a0a563-684e-40ed-9d54-e1a35e85804d" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1686b8c-efd9-45fe-97b1-a25d93edbba7]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:15 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d Jul 08 01:36:15 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:16 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d" returned: 0 in 0.835s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:16 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d Jul 08 01:36:16 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:17 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d" returned: 1 in 1.094s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:17 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d Jul 08 01:36:17 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:17 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8a0a563-684e-40ed-9d54-e1a35e85804d" returned: 0 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-quobyte-c8a0a563-684e-40ed-9d54-e1a35e85804d" released by "delete_volume" :: held 2.790s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:17 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Created reservations ['b58c79c9-7bca-4abd-94b7-c6ea50ee6cf6', '4aba3ea2-0bbd-4a82-a4e9-f3b1e9c93771', '6f3f7ead-f1b4-4583-9e67-6c21663ba4a5', 'ee72cd78-29a4-41c9-8f66-45effbb09d20'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:18 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:36:18 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:18 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:18 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Deleted volume successfully. Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7077efc6-85f6-4cd7-ad34-22b0a1f587c9 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-c8a0a563-684e-40ed-9d54-e1a35e85804d-delete_volume" released by "delete_volume" :: held 3.967s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Flow 'volume_create_manager' (4b78f133-4351-48a4-a3fb-76099096dab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787f2e66-1b45-44ab-baab-7401011615c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787f2e66-1b45-44ab-baab-7401011615c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1409278200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0ce9b6-b3c9-434f-83a9-116ec4be0635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10839cbd0d245eea9bf1bb581613938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:19Z,use_quota=True,user_id='59aba26f888d4fb3ba986aff03068ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf42f129-f75f-4f39-b0b8-9b5bee588075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf42f129-f75f-4f39-b0b8-9b5bee588075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7833ee63-df16-401b-84d8-401494fa55ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7833ee63-df16-401b-84d8-401494fa55ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0ce9b6-b3c9-434f-83a9-116ec4be0635', 'volume_name': 'volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fa57ad-bb10-403b-808f-652a74560cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fa57ad-bb10-403b-808f-652a74560cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4e9608-c83c-4b45-a8bd-9e6827c56d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Volume da0ce9b6-b3c9-434f-83a9-116ec4be0635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635', 'volume_size': 1} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1409278200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0ce9b6-b3c9-434f-83a9-116ec4be0635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10839cbd0d245eea9bf1bb581613938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:19Z,use_quota=True,user_id='59aba26f888d4fb3ba986aff03068ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Creating volume da0ce9b6-b3c9-434f-83a9-116ec4be0635 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:19 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:19 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 1073741824 Jul 08 01:36:19 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:20 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 1073741824" returned: 0 in 1.245s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:20 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 Jul 08 01:36:20 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:21 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635" returned: 0 in 1.065s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] <== create_volume: return (2367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.370s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4e9608-c83c-4b45-a8bd-9e6827c56d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e0cc84-23e5-4caa-a495-3cb3c61258ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Volume volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 (da0ce9b6-b3c9-434f-83a9-116ec4be0635): created successfully Jul 08 01:36:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e0cc84-23e5-4caa-a495-3cb3c61258ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Flow 'volume_create_manager' (4b78f133-4351-48a4-a3fb-76099096dab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-be5feb56-43b3-4bd3-be7e-c8826f6b1822 tempest-VolumesExtendTest-1643540082 None] Created volume successfully. Jul 08 01:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Creating offline snapshot 797f8273-8b67-4381-86a9-92736a2251ba of volume da0ce9b6-b3c9-434f-83a9-116ec4be0635 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:36:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dc97bc-6fba-42d5-a975-a0799359bb40]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:22 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 Jul 08 01:36:22 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:23 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635" returned: 0 in 1.127s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:23 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba 1G Jul 08 01:36:23 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:25 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba 1G" returned: 0 in 1.085s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:25 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba Jul 08 01:36:25 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:25 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba" returned: 0 in 0.819s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:25 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba is being set with open permissions: ugo+rw Jul 08 01:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:25 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba Jul 08 01:36:25 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Acquiring lock "cinder-561f9b87-3b1f-4b0a-9689-bb42dbde3539-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Lock "cinder-561f9b87-3b1f-4b0a-9689-bb42dbde3539-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Acquiring lock "cinder-quobyte-561f9b87-3b1f-4b0a-9689-bb42dbde3539" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Lock "cinder-quobyte-561f9b87-3b1f-4b0a-9689-bb42dbde3539" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eca5d34-1083-42a5-8986-faf894a9e4ab]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:26 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 Jul 08 01:36:26 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:26 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba" returned: 0 in 0.775s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:26 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.info Jul 08 01:36:26 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:27 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539" returned: 0 in 0.884s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:27 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539 Jul 08 01:36:27 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:27 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.info" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:27 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.info is being set with open permissions: ugo+rw Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:27 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.info Jul 08 01:36:27 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:27 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-561f9b87-3b1f-4b0a-9689-bb42dbde3539" returned: 0 in 0.798s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Lock "cinder-quobyte-561f9b87-3b1f-4b0a-9689-bb42dbde3539" released by "delete_volume" :: held 1.743s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Created reservations ['326873f4-2a22-404a-92a6-484838f08e79', '80785c8f-7da9-4282-81ee-155ebea58058', '54a5b11f-4270-464c-8eed-5cf8beb634ed', 'cb0c7364-38bb-457a-bf99-cf3c514ec184'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:28 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:36:28 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:28 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.info" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.511s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-95f44c5a-bfb4-414e-b9ba-c43c532a7c6f tempest-VolumesExtendTest-1643540082 None] Create snapshot completed successfully Jul 08 01:36:28 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.825s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Deleted volume successfully. Jul 08 01:36:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06c7cd81-8bd8-45b5-a6d3-8adf6dc0c75b tempest-VolumesNegativeTest-727355574 None] Lock "cinder-561f9b87-3b1f-4b0a-9689-bb42dbde3539-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-828bf42f-a737-43a7-aec2-816db44e2dd0 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-828bf42f-a737-43a7-aec2-816db44e2dd0 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acd6044-ec61-45bd-8b60-babf7439c5a2]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-828bf42f-a737-43a7-aec2-816db44e2dd0 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:29 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 Jul 08 01:36:29 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:30 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-828bf42f-a737-43a7-aec2-816db44e2dd0 tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635" returned: 0 in 0.943s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-828bf42f-a737-43a7-aec2-816db44e2dd0 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba 2G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-828bf42f-a737-43a7-aec2-816db44e2dd0 tempest-VolumesExtendTest-1643540082 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba 2G" returned: 0 in 0.208s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-828bf42f-a737-43a7-aec2-816db44e2dd0 tempest-VolumesExtendTest-1643540082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.205s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-828bf42f-a737-43a7-aec2-816db44e2dd0 tempest-VolumesExtendTest-1643540082 None] Extend volume completed successfully. Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "cinder-797f8273-8b67-4381-86a9-92736a2251ba-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-797f8273-8b67-4381-86a9-92736a2251ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "cinder-quobyte-da0ce9b6-b3c9-434f-83a9-116ec4be0635" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-quobyte-da0ce9b6-b3c9-434f-83a9-116ec4be0635" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Acquiring lock "cinder-quobyte-797f8273-8b67-4381-86a9-92736a2251ba" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-quobyte-797f8273-8b67-4381-86a9-92736a2251ba" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Deleting offline snapshot 797f8273-8b67-4381-86a9-92736a2251ba of volume da0ce9b6-b3c9-434f-83a9-116ec4be0635 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] snapshot_file for this snap is: volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d8d2d6-dd0a-4d52-922f-3eed3f5be2ab]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:31 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba Jul 08 01:36:31 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:32 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba" returned: 0 in 1.093s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df097bd-8c25-4a50-9460-d26fbae857a8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:33 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 Jul 08 01:36:33 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:33 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:33 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba Jul 08 01:36:33 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:34 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba" returned: 0 in 0.929s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:34 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba Jul 08 01:36:34 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:35 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635.797f8273-8b67-4381-86a9-92736a2251ba" returned: 0 in 0.753s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-quobyte-797f8273-8b67-4381-86a9-92736a2251ba" released by "_delete_snapshot" :: held 3.880s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-quobyte-da0ce9b6-b3c9-434f-83a9-116ec4be0635" released by "delete_snapshot" :: held 3.916s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Created reservations ['f1862afd-8820-4df0-aab2-eee2bcb419c4', '8678561d-9976-4ced-9701-fcb462b220c6', 'c4892a7f-d854-438e-9417-6ab39693d975', '3d00d5d3-7d9e-4944-b82c-07a1d2c925e0'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Delete snapshot completed successfully. Jul 08 01:36:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95972f64-5686-4984-b195-492c6ed7b5a5 tempest-VolumesExtendTest-1643540082 None] Lock "cinder-797f8273-8b67-4381-86a9-92736a2251ba-delete_snapshot" released by "delete_snapshot" :: held 4.095s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Acquiring lock "cinder-da0ce9b6-b3c9-434f-83a9-116ec4be0635-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Lock "cinder-da0ce9b6-b3c9-434f-83a9-116ec4be0635-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Acquiring lock "cinder-quobyte-da0ce9b6-b3c9-434f-83a9-116ec4be0635" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Lock "cinder-quobyte-da0ce9b6-b3c9-434f-83a9-116ec4be0635" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5266a577-96b8-4d93-bc60-544b348e5a95]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:36 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 Jul 08 01:36:36 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:37 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635" returned: 0 in 0.978s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:37 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635 Jul 08 01:36:37 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:37 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da0ce9b6-b3c9-434f-83a9-116ec4be0635" returned: 0 in 0.797s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Lock "cinder-quobyte-da0ce9b6-b3c9-434f-83a9-116ec4be0635" released by "delete_volume" :: held 1.855s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:38 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Created reservations ['abe61962-2dd0-47ee-a68a-4b1a919f35f9', 'd6643484-7872-40f1-bda0-8ed6939d6d9a', 'f2639650-84a7-4427-bf9c-e4014aaa4d6b', '1ab23534-2d00-4321-a50f-c4810cfa6bdb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:38 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:36:38 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:39 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.870s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:39 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Deleted volume successfully. Jul 08 01:36:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2daeb90-42fd-4cba-9a85-a52089a3cc2c tempest-VolumesExtendTest-1643540082 None] Lock "cinder-da0ce9b6-b3c9-434f-83a9-116ec4be0635-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Flow 'volume_create_manager' (b831ebf8-4b0e-4e78-a411-4d9971585e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01458a32-3a5b-425d-830d-a993dc134fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01458a32-3a5b-425d-830d-a993dc134fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-281032932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b0528a-f2e8-49de-a243-a513983dfa68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a169d5d411494e6ca7b3ad896c7d1ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:43Z,use_quota=True,user_id='d4f81b1e3ba44223a6857a2b6669f5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dc59d0-802f-4f04-93eb-f77fb1c20f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dc59d0-802f-4f04-93eb-f77fb1c20f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951b1b8b-3846-4e7c-881d-3a3f01290310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951b1b8b-3846-4e7c-881d-3a3f01290310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b0528a-f2e8-49de-a243-a513983dfa68', 'volume_name': 'volume-c6b0528a-f2e8-49de-a243-a513983dfa68', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065c72d8-f7df-4d71-a352-979ed60eb947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065c72d8-f7df-4d71-a352-979ed60eb947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7684204-bf26-4207-892d-84e71bf35903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:42 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Volume c6b0528a-f2e8-49de-a243-a513983dfa68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b0528a-f2e8-49de-a243-a513983dfa68', 'volume_size': 1} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-281032932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b0528a-f2e8-49de-a243-a513983dfa68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a169d5d411494e6ca7b3ad896c7d1ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:43Z,use_quota=True,user_id='d4f81b1e3ba44223a6857a2b6669f5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Creating volume c6b0528a-f2e8-49de-a243-a513983dfa68 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:42 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:36:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:43 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68 1073741824 Jul 08 01:36:43 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:44 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68 1073741824" returned: 0 in 1.105s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:44 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68 Jul 08 01:36:44 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:44 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7684204-bf26-4207-892d-84e71bf35903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b0528a-f2e8-49de-a243-a513983dfa68', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00818caf-e0fb-4f2b-b1a0-e94811cf4615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:45 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Volume volume-c6b0528a-f2e8-49de-a243-a513983dfa68 (c6b0528a-f2e8-49de-a243-a513983dfa68): created successfully Jul 08 01:36:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00818caf-e0fb-4f2b-b1a0-e94811cf4615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Flow 'volume_create_manager' (b831ebf8-4b0e-4e78-a411-4d9971585e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-30e6511f-14fc-43fe-ad29-ca483bf90268 tempest-VolumesListTestJSON-381947048 None] Created volume successfully. Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Flow 'volume_create_manager' (80c348eb-fc50-49e2-a60d-87f0f5918043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab913ff-23aa-4f21-8c30-59eeeef0abd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab913ff-23aa-4f21-8c30-59eeeef0abd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-492128121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e62b38-2f5b-40d8-a16a-bbe7e1951045,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a169d5d411494e6ca7b3ad896c7d1ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:47Z,use_quota=True,user_id='d4f81b1e3ba44223a6857a2b6669f5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f7f70-465c-48dc-8ecf-cf27ccc3d27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f7f70-465c-48dc-8ecf-cf27ccc3d27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3787845b-4765-4300-8c43-6b4a718f3b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3787845b-4765-4300-8c43-6b4a718f3b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e62b38-2f5b-40d8-a16a-bbe7e1951045', 'volume_name': 'volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9a7ea2-7986-4261-9476-82414102f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9a7ea2-7986-4261-9476-82414102f49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2374225-f268-4fe6-a8e6-7f5ed8f36710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Volume 24e62b38-2f5b-40d8-a16a-bbe7e1951045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045', 'volume_size': 1} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-492128121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e62b38-2f5b-40d8-a16a-bbe7e1951045,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a169d5d411494e6ca7b3ad896c7d1ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:47Z,use_quota=True,user_id='d4f81b1e3ba44223a6857a2b6669f5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Creating volume 24e62b38-2f5b-40d8-a16a-bbe7e1951045 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:46 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:46 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 1073741824 Jul 08 01:36:46 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:47 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 1073741824" returned: 0 in 0.960s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:47 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 Jul 08 01:36:47 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:48 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045" returned: 0 in 0.693s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2374225-f268-4fe6-a8e6-7f5ed8f36710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da933718-3329-457a-a5e4-331ca20cc83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Volume volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 (24e62b38-2f5b-40d8-a16a-bbe7e1951045): created successfully Jul 08 01:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da933718-3329-457a-a5e4-331ca20cc83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Flow 'volume_create_manager' (80c348eb-fc50-49e2-a60d-87f0f5918043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fba2ef9e-1193-4285-b3f6-c0c12c652b41 tempest-VolumesListTestJSON-381947048 None] Created volume successfully. Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Flow 'volume_create_manager' (ee757d1c-19dc-4dc3-9ae1-2c47c15bcea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798377e8-45b6-4cd2-9700-17fcf8bb7f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798377e8-45b6-4cd2-9700-17fcf8bb7f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1932395133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c828d4c-7cb7-45f9-89fe-c6205043f92f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a169d5d411494e6ca7b3ad896c7d1ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:50Z,use_quota=True,user_id='d4f81b1e3ba44223a6857a2b6669f5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f313ec41-83d1-4e8e-a73a-d646367d8275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f313ec41-83d1-4e8e-a73a-d646367d8275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18f26b1-c795-44e2-b4be-d1ecaec5eebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18f26b1-c795-44e2-b4be-d1ecaec5eebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c828d4c-7cb7-45f9-89fe-c6205043f92f', 'volume_name': 'volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1725f60-aacf-4637-8853-23f58d71e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1725f60-aacf-4637-8853-23f58d71e22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf3eff9-aeab-4438-8b02-16b76dcc6bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Volume 9c828d4c-7cb7-45f9-89fe-c6205043f92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f', 'volume_size': 1} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1932395133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c828d4c-7cb7-45f9-89fe-c6205043f92f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a169d5d411494e6ca7b3ad896c7d1ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:50Z,use_quota=True,user_id='d4f81b1e3ba44223a6857a2b6669f5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Creating volume 9c828d4c-7cb7-45f9-89fe-c6205043f92f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:49 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:36:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:49 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f 1073741824 Jul 08 01:36:49 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d2dc61a2-6f39-45f9-9333-8794ee87a9d3 req-e0b7b263-1302-4711-9c45-30c211658a64 tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:50 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f 1073741824" returned: 0 in 1.235s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:51 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f Jul 08 01:36:51 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:51 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d2dc61a2-6f39-45f9-9333-8794ee87a9d3 req-e0b7b263-1302-4711-9c45-30c211658a64 tempest-TestStampPattern-261008118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.240s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf3eff9-aeab-4438-8b02-16b76dcc6bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e7b6a1-8924-420a-b3d4-d777825c6a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eab036-7426-43e9-bcc6-db6cf6412cad]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d2dc61a2-6f39-45f9-9333-8794ee87a9d3 req-e0b7b263-1302-4711-9c45-30c211658a64 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Volume volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f (9c828d4c-7cb7-45f9-89fe-c6205043f92f): created successfully Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e7b6a1-8924-420a-b3d4-d777825c6a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Flow 'volume_create_manager' (ee757d1c-19dc-4dc3-9ae1-2c47c15bcea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d6e2aade-78e2-428b-b814-37d06720f135 tempest-VolumesListTestJSON-381947048 None] Created volume successfully. Jul 08 01:36:52 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba Jul 08 01:36:52 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:52 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d2dc61a2-6f39-45f9-9333-8794ee87a9d3 req-e0b7b263-1302-4711-9c45-30c211658a64 tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba" returned: 0 in 0.996s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d2dc61a2-6f39-45f9-9333-8794ee87a9d3 req-e0b7b263-1302-4711-9c45-30c211658a64 tempest-TestStampPattern-261008118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-d2dc61a2-6f39-45f9-9333-8794ee87a9d3 req-e0b7b263-1302-4711-9c45-30c211658a64 tempest-TestStampPattern-261008118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-492cb668-e25c-4d41-bb45-791905bda4ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c17b14eb-05f4-4b77-b174-965c03200298', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:36:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-d2dc61a2-6f39-45f9-9333-8794ee87a9d3 req-e0b7b263-1302-4711-9c45-30c211658a64 tempest-TestStampPattern-261008118 None] attachment_update completed successfully. Jul 08 01:36:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:36:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:53 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:36:53 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:54 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.147s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:36:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:36:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:36:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "cinder-9c828d4c-7cb7-45f9-89fe-c6205043f92f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Lock "cinder-9c828d4c-7cb7-45f9-89fe-c6205043f92f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "cinder-quobyte-9c828d4c-7cb7-45f9-89fe-c6205043f92f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Lock "cinder-quobyte-9c828d4c-7cb7-45f9-89fe-c6205043f92f" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6c3d60-4023-49e2-a59a-355aed7461f7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:55 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f Jul 08 01:36:55 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:56 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f" returned: 0 in 0.952s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:56 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f Jul 08 01:36:56 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:57 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9c828d4c-7cb7-45f9-89fe-c6205043f92f" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Lock "cinder-quobyte-9c828d4c-7cb7-45f9-89fe-c6205043f92f" released by "delete_volume" :: held 1.780s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Created reservations ['5d4658f4-8b16-425f-89d6-8c8962dfc53b', 'aae3d219-44d9-4665-b341-fcdf79c14511', '1b61286e-13d3-4374-b130-9c632db4d86e', '632ec0a2-ae75-4355-8bc6-8887b40325bd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:57 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:36:57 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Acquiring lock "cinder-24e62b38-2f5b-40d8-a16a-bbe7e1951045-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Lock "cinder-24e62b38-2f5b-40d8-a16a-bbe7e1951045-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Acquiring lock "cinder-quobyte-24e62b38-2f5b-40d8-a16a-bbe7e1951045" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Lock "cinder-quobyte-24e62b38-2f5b-40d8-a16a-bbe7e1951045" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8019b348-e040-49b3-a3b6-e523cb92082c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:58 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 Jul 08 01:36:58 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:58 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.952s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:58 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Deleted volume successfully. Jul 08 01:36:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e00737c-9497-4bd4-a459-fe3c99ddffd1 tempest-VolumesListTestJSON-381947048 None] Lock "cinder-9c828d4c-7cb7-45f9-89fe-c6205043f92f-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:59 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045" returned: 0 in 1.095s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:59 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045 Jul 08 01:36:59 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Flow 'volume_create_manager' (ebd80930-d176-4433-b829-12142ca58ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88f4935-e210-46af-9f10-351ed11a3703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88f4935-e210-46af-9f10-351ed11a3703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2014131072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fb4b9e-883d-49ec-8278-16a3f00bf8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f205056fc33491b848e83203e9dd2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:59Z,use_quota=True,user_id='6e5b1f9f8d9148e3a1f13d9330dd5d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b581a74-9039-48c5-af22-9b9cb1251576),volume_type_id=2b581a74-9039-48c5-af22-9b9cb1251576)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ea641d-0cea-432d-bf1c-8e840cd68011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ea641d-0cea-432d-bf1c-8e840cd68011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11461f47-5dcd-471b-ba7a-e066b50a2de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11461f47-5dcd-471b-ba7a-e066b50a2de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fb4b9e-883d-49ec-8278-16a3f00bf8f3', 'volume_name': 'volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5e3bed-a238-48b0-8399-43423ec4ab2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5e3bed-a238-48b0-8399-43423ec4ab2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a37c35e-89a6-472d-81ba-8318ee96dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Volume 94fb4b9e-883d-49ec-8278-16a3f00bf8f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3', 'volume_size': 1} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2014131072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fb4b9e-883d-49ec-8278-16a3f00bf8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f205056fc33491b848e83203e9dd2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:59Z,use_quota=True,user_id='6e5b1f9f8d9148e3a1f13d9330dd5d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b581a74-9039-48c5-af22-9b9cb1251576),volume_type_id=2b581a74-9039-48c5-af22-9b9cb1251576)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Creating volume 94fb4b9e-883d-49ec-8278-16a3f00bf8f3 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:36:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:59 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 1073741824 Jul 08 01:36:59 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:00 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Flow 'volume_create_manager' (448ae127-0294-4c21-a13e-49a68538062a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d178a552-5713-4a7f-8fc2-93689f77c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-24e62b38-2f5b-40d8-a16a-bbe7e1951045" returned: 0 in 1.063s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d178a552-5713-4a7f-8fc2-93689f77c421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-752366286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb0be6e-04ee-4d59-8374-4dd272453952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f205056fc33491b848e83203e9dd2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:00Z,use_quota=True,user_id='6e5b1f9f8d9148e3a1f13d9330dd5d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d02f782-6cef-49ed-a8ff-459b69ffa4c1),volume_type_id=7d02f782-6cef-49ed-a8ff-459b69ffa4c1)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636ea45c-8ca8-472a-b89d-8402e60ad450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636ea45c-8ca8-472a-b89d-8402e60ad450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04a007a-e3b6-4d02-a910-1ed5090e966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04a007a-e3b6-4d02-a910-1ed5090e966a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb0be6e-04ee-4d59-8374-4dd272453952', 'volume_name': 'volume-0bb0be6e-04ee-4d59-8374-4dd272453952', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef1bfe0-9d17-40e0-b93d-d5883b7ce536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef1bfe0-9d17-40e0-b93d-d5883b7ce536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438acebc-201b-4da9-8ac1-151530221280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Volume 0bb0be6e-04ee-4d59-8374-4dd272453952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb0be6e-04ee-4d59-8374-4dd272453952', 'volume_size': 1} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Lock "cinder-quobyte-24e62b38-2f5b-40d8-a16a-bbe7e1951045" released by "delete_volume" :: held 2.327s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Created reservations ['cf1accd6-25f7-497e-88a4-50bd786700d6', 'ac9dfc01-a5e0-48a3-a563-dcb7f8e19f33', '31e9c76e-8999-48a7-8fce-5c72fabe5fff', 'f747e2bc-d647-42ea-827f-b19bdf05811e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-03c7881d-333d-48c9-aa99-2fe5b35cd2df req-86d7385c-7aab-42cb-bf0b-4392dd6dfec0 tempest-TestStampPattern-261008118 None] Terminate volume connection completed successfully. Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-03c7881d-333d-48c9-aa99-2fe5b35cd2df req-86d7385c-7aab-42cb-bf0b-4392dd6dfec0 tempest-TestStampPattern-261008118 None] Deleting attachment c17b14eb-05f4-4b77-b174-965c03200298. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:37:00 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:37:00 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Flow 'volume_create_manager' (07feebcb-083e-45fb-95bb-5c7360cd204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60340f7c-6493-4800-a0ba-65ea306d22db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60340f7c-6493-4800-a0ba-65ea306d22db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-592256313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b2fedc-8402-442c-b245-a165bdb28640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f205056fc33491b848e83203e9dd2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:01Z,use_quota=True,user_id='6e5b1f9f8d9148e3a1f13d9330dd5d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27711aea-3456-4f11-aef4-e69bec24cfd7),volume_type_id=27711aea-3456-4f11-aef4-e69bec24cfd7)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadf8587-7015-44d0-a167-93838130cad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadf8587-7015-44d0-a167-93838130cad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f92cf33-6591-491f-b6d7-ddd8c4069174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:37:01 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 1073741824" returned: 0 in 1.487s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:01 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 Jul 08 01:37:01 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f92cf33-6591-491f-b6d7-ddd8c4069174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00b2fedc-8402-442c-b245-a165bdb28640', 'volume_name': 'volume-00b2fedc-8402-442c-b245-a165bdb28640', 'volume_size': 1, 'image_id': '3a255cae-1150-4095-9018-a855b64dc170', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a255cae-1150-4095-9018-a855b64dc170', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1394593230', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f205056fc33491b848e83203e9dd2c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a255cae-1150-4095-9018-a855b64dc170', 'created_at': datetime.datetime(2026, 7, 7, 23, 36, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 36, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a255cae-1150-4095-9018-a855b64dc170/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1cdeb5-3c99-49c7-b217-8c1d5c4e5a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1cdeb5-3c99-49c7-b217-8c1d5c4e5a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd95493e-e0c4-4b52-8c5a-b1b39451ee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Volume 00b2fedc-8402-442c-b245-a165bdb28640: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00b2fedc-8402-442c-b245-a165bdb28640', 'volume_size': 1, 'image_id': '3a255cae-1150-4095-9018-a855b64dc170', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a255cae-1150-4095-9018-a855b64dc170', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1394593230', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f205056fc33491b848e83203e9dd2c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a255cae-1150-4095-9018-a855b64dc170', 'created_at': datetime.datetime(2026, 7, 7, 23, 36, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 36, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a255cae-1150-4095-9018-a855b64dc170/file', 'properties': {}}, 'image_service': } Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Trying to clone 00b2fedc-8402-442c-b245-a165bdb28640 from image 3a255cae-1150-4095-9018-a855b64dc170 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a255cae-1150-4095-9018-a855b64dc170', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "cinder-c6b0528a-f2e8-49de-a243-a513983dfa68-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:01 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Lock "cinder-c6b0528a-f2e8-49de-a243-a513983dfa68-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.992s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Deleted volume successfully. Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-520eb742-e092-44e3-9132-00048b374a5a tempest-VolumesListTestJSON-381947048 None] Lock "cinder-24e62b38-2f5b-40d8-a16a-bbe7e1951045-delete_volume" released by "delete_volume" :: held 3.808s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "cinder-quobyte-c6b0528a-f2e8-49de-a243-a513983dfa68" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Lock "cinder-quobyte-c6b0528a-f2e8-49de-a243-a513983dfa68" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b1241d-f715-4af5-acd2-dc0538451092]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:01 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68 Jul 08 01:37:01 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:02 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3" returned: 0 in 0.977s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] <== create_volume: return (2529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.532s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.851s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-752366286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb0be6e-04ee-4d59-8374-4dd272453952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f205056fc33491b848e83203e9dd2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:00Z,use_quota=True,user_id='6e5b1f9f8d9148e3a1f13d9330dd5d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d02f782-6cef-49ed-a8ff-459b69ffa4c1),volume_type_id=7d02f782-6cef-49ed-a8ff-459b69ffa4c1)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Creating volume 0bb0be6e-04ee-4d59-8374-4dd272453952 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:02 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a37c35e-89a6-472d-81ba-8318ee96dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:02 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 1073741824 Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769297bf-8358-48df-b70e-4b27aacdd39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:02 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Volume volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 (94fb4b9e-883d-49ec-8278-16a3f00bf8f3): created successfully Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769297bf-8358-48df-b70e-4b27aacdd39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Flow 'volume_create_manager' (ebd80930-d176-4433-b829-12142ca58ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8358b6d2-a029-46dd-9723-4c8170738cee tempest-TestInstancesWithCinderVolumes-1513293405 None] Created volume successfully. Jul 08 01:37:02 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68" returned: 0 in 1.141s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:02 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68 Jul 08 01:37:02 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:03 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 1073741824" returned: 0 in 1.288s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:03 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 Jul 08 01:37:03 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:03 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c6b0528a-f2e8-49de-a243-a513983dfa68" returned: 0 in 0.924s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Lock "cinder-quobyte-c6b0528a-f2e8-49de-a243-a513983dfa68" released by "delete_volume" :: held 2.156s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:03 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Created reservations ['b2b212cc-1ccb-4b8d-b7cf-0ee13017e063', '85d086cb-86f5-4dfc-8a73-62fd730aa83d', '62ffdb25-73dd-40dc-8e64-7c319f3f8f57', 'b788430e-175a-46fd-98c6-19522a936907'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:04 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:37:04 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:04 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952" returned: 0 in 0.942s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.319s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438acebc-201b-4da9-8ac1-151530221280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb0be6e-04ee-4d59-8374-4dd272453952', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3ba201-3a39-4efb-8e82-c7eb8816203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Volume volume-0bb0be6e-04ee-4d59-8374-4dd272453952 (0bb0be6e-04ee-4d59-8374-4dd272453952): created successfully Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3ba201-3a39-4efb-8e82-c7eb8816203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Flow 'volume_create_manager' (448ae127-0294-4c21-a13e-49a68538062a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0624da59-38d7-4260-bd56-91bd01490475 tempest-TestInstancesWithCinderVolumes-1513293405 None] Created volume successfully. Jul 08 01:37:04 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.881s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:04 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Deleted volume successfully. Jul 08 01:37:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac559230-951f-4fba-bc22-87067ac91f49 tempest-VolumesListTestJSON-381947048 None] Lock "cinder-c6b0528a-f2e8-49de-a243-a513983dfa68-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:05 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD, size 20.69 MB, duration 4.60 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:37:05 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Image download 20.69 MB at 4.50 MB/s Jul 08 01:37:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5532ff9-e0e0-4ce8-80f8-aba78c611b0a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:06 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD Jul 08 01:37:06 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:07 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD" returned: 0 in 1.010s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:07 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Temporary image 3a255cae-1150-4095-9018-a855b64dc170 is fetched for user 6e5b1f9f8d9148e3a1f13d9330dd5d1e. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:37:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cf2330-f0ff-4420-930d-66279f42e2d6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:07 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD Jul 08 01:37:07 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:08 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD" returned: 0 in 0.918s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-592256313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b2fedc-8402-442c-b245-a165bdb28640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f205056fc33491b848e83203e9dd2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:01Z,use_quota=True,user_id='6e5b1f9f8d9148e3a1f13d9330dd5d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27711aea-3456-4f11-aef4-e69bec24cfd7),volume_type_id=27711aea-3456-4f11-aef4-e69bec24cfd7)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Creating volume 00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:37:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:08 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 1073741824 Jul 08 01:37:08 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:09 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 1073741824" returned: 0 in 1.018s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:09 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 Jul 08 01:37:09 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:09 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640" returned: 0 in 0.833s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:10 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=85,cinder:DELETE=8,cinder:SELECT=61,cinder:INSERT=22 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:37:10 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=67,cinder:UPDATE=82,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:37:10 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Attempting download of 3a255cae-1150-4095-9018-a855b64dc170 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a255cae-1150-4095-9018-a855b64dc170', 'metadata': {}}])) to volume 00b2fedc-8402-442c-b245-a165bdb28640. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:37:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[692de813-7318-4094-9d72-3f116f49b59b]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a255cae-1150-4095-9018-a855b64dc170_arqhk79z {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:10 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a255cae-1150-4095-9018-a855b64dc170_arqhk79z Jul 08 01:37:10 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:11 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a255cae-1150-4095-9018-a855b64dc170_arqhk79z" returned: 0 in 0.945s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a255cae-1150-4095-9018-a855b64dc170_arqhk79z {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:11 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a255cae-1150-4095-9018-a855b64dc170_arqhk79z Jul 08 01:37:11 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Acquiring lock "cinder-492cb668-e25c-4d41-bb45-791905bda4ba-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Lock "cinder-492cb668-e25c-4d41-bb45-791905bda4ba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Acquiring lock "cinder-quobyte-492cb668-e25c-4d41-bb45-791905bda4ba" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:11 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a255cae-1150-4095-9018-a855b64dc170_arqhk79z" returned: 1 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a255cae-1150-4095-9018-a855b64dc170_arqhk79z' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b26640-1340-4020-bfdb-1655696046cb]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-492cb668-e25c-4d41-bb45-791905bda4ba" acquired by "delete_volume" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff72aeb1-aa40-44a8-a482-abf05aafb14b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:12 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD Jul 08 01:37:12 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:12 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba Jul 08 01:37:12 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:12 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD" returned: 0 in 0.947s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:12 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] 3a255cae-1150-4095-9018-a855b64dc170 was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:37:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:12 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 Jul 08 01:37:12 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:12 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:12 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba Jul 08 01:37:12 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:13 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-492cb668-e25c-4d41-bb45-791905bda4ba" returned: 0 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-492cb668-e25c-4d41-bb45-791905bda4ba" released by "delete_volume" :: held 1.818s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Created reservations ['db6cedd8-01ef-40b6-94c5-ad533d7da624', '164fef42-ffa7-4f93-9052-70c3ad0bf3c6', 'a6fe3105-4bd0-49a6-b1bb-7fbd795cc77b', 'bdbf0820-0a43-46a0-b0d8-242dec5480d7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:14 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:37:14 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Acquiring lock "cinder-a9267f56-fb95-4fc1-bd34-6e68d06f8b56-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Lock "cinder-a9267f56-fb95-4fc1-bd34-6e68d06f8b56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Acquiring lock "cinder-quobyte-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Acquiring lock "cinder-quobyte-a9267f56-fb95-4fc1-bd34-6e68d06f8b56" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-a9267f56-fb95-4fc1-bd34-6e68d06f8b56" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Deleting offline snapshot a9267f56-fb95-4fc1-bd34-6e68d06f8b56 of volume bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] snapshot_file for this snap is: volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[187f3356-6004-4446-95fe-74900cd2bffe]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:15 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 Jul 08 01:37:15 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:15 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.094s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Deleted volume successfully. Jul 08 01:37:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6a9e42aa-0a22-47de-8e53-c80e5450a5a0 tempest-TestStampPattern-261008118 None] Lock "cinder-492cb668-e25c-4d41-bb45-791905bda4ba-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:15 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640" returned: 0 in 2.803s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:15 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a255cae-1150-4095-9018-a855b64dc170_o7lvyr9wdevstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:37:15 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Converted 112.00 MB image at 39.94 MB/s Jul 08 01:37:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:15 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 1G Jul 08 01:37:15 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:16 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56" returned: 0 in 1.189s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0f9e61-c575-4acd-9a85-97d4259abe25]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:16 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 Jul 08 01:37:16 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:16 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 1G" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99e3b6e-ec8d-4224-aa7f-a1e4dcb247f4]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:16 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 Jul 08 01:37:16 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:17 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" returned: 0 in 1.090s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:17 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 Jul 08 01:37:17 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:17 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640" returned: 0 in 0.977s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:17 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 Jul 08 01:37:17 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:18 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56" returned: 0 in 0.886s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:18 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56 Jul 08 01:37:18 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:18 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640" returned: 1 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Downloaded image 3a255cae-1150-4095-9018-a855b64dc170 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a255cae-1150-4095-9018-a855b64dc170', 'metadata': {}}])) to volume 00b2fedc-8402-442c-b245-a165bdb28640 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Temporary image 3a255cae-1150-4095-9018-a855b64dc170 for user 6e5b1f9f8d9148e3a1f13d9330dd5d1e is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Marking volume 00b2fedc-8402-442c-b245-a165bdb28640 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Copying metadata from image 3a255cae-1150-4095-9018-a855b64dc170 to 00b2fedc-8402-442c-b245-a165bdb28640. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Creating volume glance metadata for volume 00b2fedc-8402-442c-b245-a165bdb28640 backed by image 3a255cae-1150-4095-9018-a855b64dc170 with: {'image_id': '3a255cae-1150-4095-9018-a855b64dc170', 'image_name': 'tempest-scenario-img--1394593230', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd95493e-e0c4-4b52-8c5a-b1b39451ee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b2fedc-8402-442c-b245-a165bdb28640', 'volume_size': 1, 'image_id': '3a255cae-1150-4095-9018-a855b64dc170', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a255cae-1150-4095-9018-a855b64dc170', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1394593230', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f205056fc33491b848e83203e9dd2c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a255cae-1150-4095-9018-a855b64dc170', 'created_at': datetime.datetime(2026, 7, 7, 23, 36, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 36, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a255cae-1150-4095-9018-a855b64dc170/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826a73a9-76aa-4a32-8185-db62807dddeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Volume volume-00b2fedc-8402-442c-b245-a165bdb28640 (00b2fedc-8402-442c-b245-a165bdb28640): created successfully Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826a73a9-76aa-4a32-8185-db62807dddeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Flow 'volume_create_manager' (07feebcb-083e-45fb-95bb-5c7360cd204c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e16a230f-750f-4e8c-86ce-5ab9279f6867 tempest-TestInstancesWithCinderVolumes-1513293405 None] Created volume successfully. Jul 08 01:37:18 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8.a9267f56-fb95-4fc1-bd34-6e68d06f8b56" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-a9267f56-fb95-4fc1-bd34-6e68d06f8b56" released by "_delete_snapshot" :: held 4.140s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" released by "delete_snapshot" :: held 4.177s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:19 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Created reservations ['a4df22ff-7eca-469b-8a16-b3bf88ce486a', '7a33b43d-ec7c-4165-a692-833a9849584c', '25475df2-4507-40d0-bf8a-d61d37586f11', '5f11fcfb-3e62-458c-926a-1bd006df9afe'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Delete snapshot completed successfully. Jul 08 01:37:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6efb290b-d1e3-4642-9189-752900416004 tempest-TestStampPattern-261008118 None] Lock "cinder-a9267f56-fb95-4fc1-bd34-6e68d06f8b56-delete_snapshot" released by "delete_snapshot" :: held 4.370s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (9536ea4e-c575-4ae8-8e98-ce80330ebe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20c3537-dcef-4c6c-b562-4b7694e9bd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20c3537-dcef-4c6c-b562-4b7694e9bd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-812094208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70db9c0-0652-409a-b331-b041e0d65921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f394d904b54ef3b76aa55b12396d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:21Z,use_quota=True,user_id='95b6516d6ec24491accf7f9f29cf12fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60064842-d1cd-4f8a-a488-82319741b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60064842-d1cd-4f8a-a488-82319741b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47e7fe9-9359-4e46-b5e8-91278813e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47e7fe9-9359-4e46-b5e8-91278813e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70db9c0-0652-409a-b331-b041e0d65921', 'volume_name': 'volume-d70db9c0-0652-409a-b331-b041e0d65921', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4949d69f-fc75-48b6-8724-f99d06eef25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4949d69f-fc75-48b6-8724-f99d06eef25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13af025-e40d-43cd-aee5-4ee51d2cc83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Volume d70db9c0-0652-409a-b331-b041e0d65921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70db9c0-0652-409a-b331-b041e0d65921', 'volume_size': 1} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-812094208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70db9c0-0652-409a-b331-b041e0d65921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f394d904b54ef3b76aa55b12396d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:21Z,use_quota=True,user_id='95b6516d6ec24491accf7f9f29cf12fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Creating volume d70db9c0-0652-409a-b331-b041e0d65921 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:21 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:37:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:21 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 1073741824 Jul 08 01:37:21 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:22 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 1073741824" returned: 0 in 1.111s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:22 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 Jul 08 01:37:22 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:23 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921" returned: 0 in 0.892s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13af025-e40d-43cd-aee5-4ee51d2cc83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70db9c0-0652-409a-b331-b041e0d65921', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43eb4eb4-25ff-4b22-bb78-ded94f811dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Volume volume-d70db9c0-0652-409a-b331-b041e0d65921 (d70db9c0-0652-409a-b331-b041e0d65921): created successfully Jul 08 01:37:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43eb4eb4-25ff-4b22-bb78-ded94f811dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (9536ea4e-c575-4ae8-8e98-ce80330ebe41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-171beca7-c4a9-4135-8c6d-23ded18beee4 tempest-VolumesSnapshotTestJSON-1218638142 None] Created volume successfully. Jul 08 01:37:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Creating offline snapshot 56742b20-5f64-4209-9173-d9104df85a4a of volume d70db9c0-0652-409a-b331-b041e0d65921 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:37:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8017f5-d3fd-46d9-8754-6c41a39c4ac0]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:24 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 Jul 08 01:37:24 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:25 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921" returned: 0 in 0.861s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:25 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a 1G Jul 08 01:37:25 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:26 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a 1G" returned: 0 in 1.041s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d70db9c0-0652-409a-b331-b041e0d65921 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:26 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d70db9c0-0652-409a-b331-b041e0d65921 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a Jul 08 01:37:26 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:27 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d70db9c0-0652-409a-b331-b041e0d65921 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a" returned: 0 in 1.101s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:27 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a is being set with open permissions: ugo+rw Jul 08 01:37:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:27 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a Jul 08 01:37:27 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:28 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a" returned: 0 in 0.769s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:28 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.info Jul 08 01:37:28 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Acquiring lock "cinder-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Lock "cinder-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:29 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.info" returned: 0 in 0.708s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:29 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.info is being set with open permissions: ugo+rw Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:29 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.info Jul 08 01:37:29 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Acquiring lock "cinder-quobyte-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee294d08-fb74-431b-ad2b-54eac83f8087]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:29 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 Jul 08 01:37:29 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:29 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.info" returned: 0 in 0.704s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.305s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.444s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb0ac70-09af-43fc-b340-7c1cdba25c7c]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cc9d5d28-4866-414b-a292-77e53e05d577 tempest-VolumesSnapshotTestJSON-1218638142 None] Create snapshot completed successfully Jul 08 01:37:30 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 Jul 08 01:37:30 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:30 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" returned: 0 in 0.890s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:30 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8 Jul 08 01:37:30 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:30 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640" returned: 0 in 0.852s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:30 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Lock "cinder-quobyte-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8" released by "delete_volume" :: held 1.712s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:31 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 Jul 08 01:37:31 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Created reservations ['5e24898c-cd44-4216-bcb0-09fe35cc2a9d', 'a85cbc38-db59-4a3b-9e15-c82a531da192', '1ab51932-7269-4161-948b-25b85a9f4898', '81943fb8-5690-4d73-a92a-26c0ea37dd80'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-56742b20-5f64-4209-9173-d9104df85a4a-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-56742b20-5f64-4209-9173-d9104df85a4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:31 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:37:31 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-d70db9c0-0652-409a-b331-b041e0d65921" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-d70db9c0-0652-409a-b331-b041e0d65921" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-56742b20-5f64-4209-9173-d9104df85a4a" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-56742b20-5f64-4209-9173-d9104df85a4a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Deleting offline snapshot 56742b20-5f64-4209-9173-d9104df85a4a of volume d70db9c0-0652-409a-b331-b041e0d65921 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] snapshot_file for this snap is: volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bc70e7-e0e5-4f7a-9621-c98a879b2e68]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:31 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a Jul 08 01:37:31 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:31 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640" returned: 1 in 1.049s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.968s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-00b2fedc-8402-442c-b245-a165bdb28640', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef97b939-2c2a-4c0e-90a6-bf0e74ff3456', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:37:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-39ee4a0e-e15e-48cb-80da-adeb54021c00 req-af335bfe-1232-414c-81e6-4bf4ae925674 tempest-TestInstancesWithCinderVolumes-1513293405 None] attachment_update completed successfully. Jul 08 01:37:32 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:32 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Deleted volume successfully. Jul 08 01:37:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e222c1ef-3aca-463c-8e81-70fa81359799 tempest-TestStampPattern-261008118 None] Lock "cinder-bec33f5a-9a8a-46df-bc6c-2cdb0b3f48e8-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:32 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a" returned: 0 in 0.964s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d70db9c0-0652-409a-b331-b041e0d65921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f886a3-3bd1-4930-b7cd-a03450089dbc]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:32 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 Jul 08 01:37:32 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:33 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921" returned: 0 in 0.990s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:33 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a Jul 08 01:37:33 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:34 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a" returned: 0 in 0.918s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:34 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a Jul 08 01:37:34 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:35 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921.56742b20-5f64-4209-9173-d9104df85a4a" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-56742b20-5f64-4209-9173-d9104df85a4a" released by "_delete_snapshot" :: held 3.822s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-d70db9c0-0652-409a-b331-b041e0d65921" released by "delete_snapshot" :: held 3.853s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Created reservations ['afa37d7d-f84e-4651-a955-54a14ee37274', '39f72f15-29b4-4b5c-8d45-d7716b7189a8', '097eab9c-ab82-48e0-b510-b2eedb12fd6c', '74bd51b6-523a-4a07-a0b3-99effa0ff150'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Delete snapshot completed successfully. Jul 08 01:37:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bddd1f9c-0714-47f4-bb26-fa44243cb29c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-56742b20-5f64-4209-9173-d9104df85a4a-delete_snapshot" released by "delete_snapshot" :: held 4.183s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (5eb3b20b-bc3f-4620-8d94-757471271918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a72d6f-295c-4533-82dd-1f36341ea979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a72d6f-295c-4533-82dd-1f36341ea979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974101763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853e877b-741e-4db0-bf95-e1935feedbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f394d904b54ef3b76aa55b12396d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:37Z,use_quota=True,user_id='95b6516d6ec24491accf7f9f29cf12fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb38219-3716-4b3c-8b65-d94e24e5bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb38219-3716-4b3c-8b65-d94e24e5bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88a8189-33dc-45e1-bee1-32069c8af707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88a8189-33dc-45e1-bee1-32069c8af707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853e877b-741e-4db0-bf95-e1935feedbe4', 'volume_name': 'volume-853e877b-741e-4db0-bf95-e1935feedbe4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78c9489-de61-4b1a-8354-dd6c23997f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78c9489-de61-4b1a-8354-dd6c23997f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a20755-4404-44d0-ad9e-8a5868d3893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:36 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Volume 853e877b-741e-4db0-bf95-e1935feedbe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853e877b-741e-4db0-bf95-e1935feedbe4', 'volume_size': 1} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974101763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853e877b-741e-4db0-bf95-e1935feedbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f394d904b54ef3b76aa55b12396d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:37Z,use_quota=True,user_id='95b6516d6ec24491accf7f9f29cf12fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Creating volume 853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:36 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:37:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:36 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 1073741824 Jul 08 01:37:36 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:38 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 1073741824" returned: 0 in 1.178s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:38 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 Jul 08 01:37:38 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:39 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4" returned: 0 in 0.913s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a20755-4404-44d0-ad9e-8a5868d3893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853e877b-741e-4db0-bf95-e1935feedbe4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fc5b4d-df45-4fa6-8753-c282aaa12202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Volume volume-853e877b-741e-4db0-bf95-e1935feedbe4 (853e877b-741e-4db0-bf95-e1935feedbe4): created successfully Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fc5b4d-df45-4fa6-8753-c282aaa12202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (5eb3b20b-bc3f-4620-8d94-757471271918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5bcef869-2bf1-4154-9612-cc56b959965c tempest-VolumesSnapshotTestJSON-1218638142 None] Created volume successfully. Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Creating offline snapshot 303ef9e9-6c44-44e5-9b01-2b9f2e703688 of volume 853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c844b-5c2e-41a2-86d6-2cbe106cf6c7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:40 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 Jul 08 01:37:40 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:41 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4" returned: 0 in 1.252s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:41 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 1G Jul 08 01:37:41 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:42 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 1G" returned: 0 in 1.567s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-853e877b-741e-4db0-bf95-e1935feedbe4 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:42 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-853e877b-741e-4db0-bf95-e1935feedbe4 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 Jul 08 01:37:42 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:44 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-853e877b-741e-4db0-bf95-e1935feedbe4 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688" returned: 0 in 1.352s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:44 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 is being set with open permissions: ugo+rw Jul 08 01:37:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:44 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 Jul 08 01:37:44 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:45 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688" returned: 0 in 1.071s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:45 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.info Jul 08 01:37:45 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:46 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.info" returned: 0 in 1.364s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:46 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.info is being set with open permissions: ugo+rw Jul 08 01:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:46 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.info Jul 08 01:37:46 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:47 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.info" returned: 0 in 1.173s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.959s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-52486554-7569-4528-83e7-cfda2e1cf8bb tempest-VolumesSnapshotTestJSON-1218638142 None] Create snapshot completed successfully Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (f9178d32-42e3-47bf-a796-1488657cd8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ea3f82-e7bb-4462-9782-16d30c2e56af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ea3f82-e7bb-4462-9782-16d30c2e56af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1123103670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d4ea09-6a59-4340-873b-be4b79b7ac75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f394d904b54ef3b76aa55b12396d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=303ef9e9-6c44-44e5-9b01-2b9f2e703688,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:50Z,use_quota=True,user_id='95b6516d6ec24491accf7f9f29cf12fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482e45a4-39e9-40fa-80c6-88b832e9cda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482e45a4-39e9-40fa-80c6-88b832e9cda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c129f0-4977-473c-81b7-b588d0b711bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c129f0-4977-473c-81b7-b588d0b711bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2d4ea09-6a59-4340-873b-be4b79b7ac75', 'volume_name': 'volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75', 'volume_size': 2, 'snapshot_id': '303ef9e9-6c44-44e5-9b01-2b9f2e703688'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b27136f-c9b8-4a04-bd83-1a6896219f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b27136f-c9b8-4a04-bd83-1a6896219f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7640a660-c9cc-4ddf-9bcf-a577719d35b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Volume d2d4ea09-6a59-4340-873b-be4b79b7ac75: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75', 'volume_size': 2, 'snapshot_id': '303ef9e9-6c44-44e5-9b01-2b9f2e703688'} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-303ef9e9-6c44-44e5-9b01-2b9f2e703688-d2d4ea09-6a59-4340-873b-be4b79b7ac75" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Flow 'volume_create_manager' (34f19529-5ad1-4ddc-b495-7ff79dcc7fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800bfa2a-12f7-4c08-a021-ce401f4cfd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800bfa2a-12f7-4c08-a021-ce401f4cfd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628203284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98650bc-b00f-4f97-be37-370555d32f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e04e1e2c324ade92a5e969bf32bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:50Z,use_quota=True,user_id='c7c9d3304293431590e1a4dc23670994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d6693a-3842-4834-8e6a-88ba3876d065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d6693a-3842-4834-8e6a-88ba3876d065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f11d7e7-f597-4301-8419-3fda895a1487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f11d7e7-f597-4301-8419-3fda895a1487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98650bc-b00f-4f97-be37-370555d32f0f', 'volume_name': 'volume-f98650bc-b00f-4f97-be37-370555d32f0f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3b9664-58df-4544-980c-c1f31a4fc89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3b9664-58df-4544-980c-c1f31a4fc89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4b2639-3942-4fbb-874c-5b0aa3d6c520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Volume f98650bc-b00f-4f97-be37-370555d32f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98650bc-b00f-4f97-be37-370555d32f0f', 'volume_size': 1} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-303ef9e9-6c44-44e5-9b01-2b9f2e703688-d2d4ea09-6a59-4340-873b-be4b79b7ac75" acquired by "_create_volume_from_snapshot" :: waited 0.120s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Creating volume d2d4ea09-6a59-4340-873b-be4b79b7ac75 from snapshot 303ef9e9-6c44-44e5-9b01-2b9f2e703688 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-d2d4ea09-6a59-4340-873b-be4b79b7ac75" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-d2d4ea09-6a59-4340-873b-be4b79b7ac75" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] snapshot: 303ef9e9-6c44-44e5-9b01-2b9f2e703688, volume: d2d4ea09-6a59-4340-873b-be4b79b7ac75, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63585ed-e768-44f3-abfa-5a8521ffc5e0]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:50 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 Jul 08 01:37:50 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:51 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688" returned: 0 in 0.948s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-853e877b-741e-4db0-bf95-e1935feedbe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:37:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:37:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[55181732-3703-48a0-9d99-b355f7e46de5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:51 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 Jul 08 01:37:51 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:52 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4" returned: 0 in 0.877s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:52 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:37:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:52 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 Jul 08 01:37:52 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:37:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:53 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:37:53 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:55 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 2.090s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:55 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:37:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:37:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:37:58 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75" returned: 0 in 6.035s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b07937-390e-4b75-814e-fda56bab8176]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:58 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 Jul 08 01:37:58 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:59 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:37:59 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Converted 1024.00 MB image at 169.64 MB/s Jul 08 01:37:59 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 is being set with open permissions: ugo+rw Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:59 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 Jul 08 01:37:59 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:59 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75" returned: 0 in 0.651s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-d2d4ea09-6a59-4340-873b-be4b79b7ac75" released by "_copy_volume_from_snapshot" :: held 9.578s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-303ef9e9-6c44-44e5-9b01-2b9f2e703688-d2d4ea09-6a59-4340-873b-be4b79b7ac75" released by "_create_volume_from_snapshot" :: held 9.624s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.748s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.630s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628203284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98650bc-b00f-4f97-be37-370555d32f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e04e1e2c324ade92a5e969bf32bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:50Z,use_quota=True,user_id='c7c9d3304293431590e1a4dc23670994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Creating volume f98650bc-b00f-4f97-be37-370555d32f0f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:59 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f 1073741824 Jul 08 01:37:59 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7640a660-c9cc-4ddf-9bcf-a577719d35b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75', 'volume_size': 2, 'snapshot_id': '303ef9e9-6c44-44e5-9b01-2b9f2e703688'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53adf3a9-a401-44e6-95a3-e0ac59820c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Volume volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 (d2d4ea09-6a59-4340-873b-be4b79b7ac75): created successfully Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53adf3a9-a401-44e6-95a3-e0ac59820c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (f9178d32-42e3-47bf-a796-1488657cd8c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ba92ded9-da8a-4364-b7bf-a7bc28da931e tempest-VolumesSnapshotTestJSON-1218638142 None] Created volume successfully. Jul 08 01:38:00 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f 1073741824" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:00 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f Jul 08 01:38:00 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-d2d4ea09-6a59-4340-873b-be4b79b7ac75-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-d2d4ea09-6a59-4340-873b-be4b79b7ac75-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-d2d4ea09-6a59-4340-873b-be4b79b7ac75" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-d2d4ea09-6a59-4340-873b-be4b79b7ac75" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e131bac-4c69-44be-9315-40890175c5eb]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:00 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 Jul 08 01:38:00 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:01 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f" returned: 0 in 0.687s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4b2639-3942-4fbb-874c-5b0aa3d6c520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98650bc-b00f-4f97-be37-370555d32f0f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b910c44d-abdb-4958-8f05-e8339d565789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Volume volume-f98650bc-b00f-4f97-be37-370555d32f0f (f98650bc-b00f-4f97-be37-370555d32f0f): created successfully Jul 08 01:38:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b910c44d-abdb-4958-8f05-e8339d565789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Flow 'volume_create_manager' (34f19529-5ad1-4ddc-b495-7ff79dcc7fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8027acaa-aac0-4a85-9dea-1d25018f4441 tempest-ProjectReaderTests-924709970 None] Created volume successfully. Jul 08 01:38:01 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:01 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75 Jul 08 01:38:01 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Acquiring lock "cinder-f98650bc-b00f-4f97-be37-370555d32f0f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:02 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Lock "cinder-f98650bc-b00f-4f97-be37-370555d32f0f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d2d4ea09-6a59-4340-873b-be4b79b7ac75" returned: 0 in 0.663s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-d2d4ea09-6a59-4340-873b-be4b79b7ac75" released by "delete_volume" :: held 1.474s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Acquiring lock "cinder-quobyte-f98650bc-b00f-4f97-be37-370555d32f0f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Lock "cinder-quobyte-f98650bc-b00f-4f97-be37-370555d32f0f" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e69aec6-e274-44a0-8ce2-9aed2c87a7e8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Created reservations ['88748536-66ef-4c77-b440-193ed1d0e9b0', '74fc2291-27d9-4464-987e-4721f1535a1e', '3a6b9941-3d74-45ed-a175-0faba324c788', '857c6aee-6ab0-473d-a501-3e817c0ba177'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:02 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f Jul 08 01:38:02 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:02 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:02 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-303ef9e9-6c44-44e5-9b01-2b9f2e703688-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-303ef9e9-6c44-44e5-9b01-2b9f2e703688-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-853e877b-741e-4db0-bf95-e1935feedbe4" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-853e877b-741e-4db0-bf95-e1935feedbe4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-303ef9e9-6c44-44e5-9b01-2b9f2e703688" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-303ef9e9-6c44-44e5-9b01-2b9f2e703688" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Deleting offline snapshot 303ef9e9-6c44-44e5-9b01-2b9f2e703688 of volume 853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] snapshot_file for this snap is: volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e372502-bebc-429a-93ae-2f18f1646e42]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:03 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.706s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Deleted volume successfully. Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-280ea7d4-22f5-4e1c-84e6-57d9cdc2d421 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-d2d4ea09-6a59-4340-873b-be4b79b7ac75-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:03 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 Jul 08 01:38:03 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:03 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f" returned: 0 in 0.877s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:03 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f Jul 08 01:38:03 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:03 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f98650bc-b00f-4f97-be37-370555d32f0f" returned: 0 in 0.717s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:03 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688" returned: 0 in 0.863s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-853e877b-741e-4db0-bf95-e1935feedbe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Lock "cinder-quobyte-f98650bc-b00f-4f97-be37-370555d32f0f" released by "delete_volume" :: held 1.668s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e1f3d1-39e0-4cda-b37b-b2778f5de60b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Created reservations ['789fd7fa-a888-4bd3-8180-d9d150dbde97', '06f417a9-ff73-4cf3-b1ad-e92fbabeb85d', '7727a6a4-276d-4558-8eb9-09faac771089', 'dd9f2337-9e80-42ab-802c-95025e3667b7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:04 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 Jul 08 01:38:04 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:04 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:04 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:04 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.714s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:04 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4" returned: 0 in 0.913s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Deleted volume successfully. Jul 08 01:38:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f1460e61-53ce-4478-aa45-624ae3cfbfec tempest-ProjectReaderTests-924709970 None] Lock "cinder-f98650bc-b00f-4f97-be37-370555d32f0f-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:04 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 Jul 08 01:38:04 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Flow 'volume_create_manager' (e5f9acf2-3c97-4ada-ada2-d995f5c97fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f0df71-c999-4b2c-b3bd-289b7734d615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f0df71-c999-4b2c-b3bd-289b7734d615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620909690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56a76fe-2870-4936-810b-f5ff88eee3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e04e1e2c324ade92a5e969bf32bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:05Z,use_quota=True,user_id='c7c9d3304293431590e1a4dc23670994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d935158-9327-4bd1-a3ce-ea335ae404ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d935158-9327-4bd1-a3ce-ea335ae404ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de49c09-3d71-4c36-af1d-2eec5ea9dacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de49c09-3d71-4c36-af1d-2eec5ea9dacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56a76fe-2870-4936-810b-f5ff88eee3bf', 'volume_name': 'volume-d56a76fe-2870-4936-810b-f5ff88eee3bf', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9269de9d-4e9d-45b5-8219-f275d91d34dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9269de9d-4e9d-45b5-8219-f275d91d34dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb818b8-a5ee-48e7-9765-768af8d83324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Volume d56a76fe-2870-4936-810b-f5ff88eee3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56a76fe-2870-4936-810b-f5ff88eee3bf', 'volume_size': 1} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620909690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56a76fe-2870-4936-810b-f5ff88eee3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e04e1e2c324ade92a5e969bf32bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:05Z,use_quota=True,user_id='c7c9d3304293431590e1a4dc23670994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Creating volume d56a76fe-2870-4936-810b-f5ff88eee3bf {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:05 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:05 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf 1073741824 Jul 08 01:38:05 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:05 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688" returned: 0 in 0.968s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:05 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688 Jul 08 01:38:05 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:06 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf 1073741824" returned: 0 in 0.975s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:06 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf Jul 08 01:38:06 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:06 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4.303ef9e9-6c44-44e5-9b01-2b9f2e703688" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-303ef9e9-6c44-44e5-9b01-2b9f2e703688" released by "_delete_snapshot" :: held 3.614s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-853e877b-741e-4db0-bf95-e1935feedbe4" released by "delete_snapshot" :: held 3.668s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:06 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Created reservations ['653cc7c7-886a-481a-841a-ffa6eae4fb4a', '2fbab439-7d7b-4cbd-aa28-40678bb96778', '2974d81e-8f42-41cb-8d55-23ab8f62672d', 'ba437f30-a896-40a3-89ec-0f293fab0689'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Delete snapshot completed successfully. Jul 08 01:38:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73d2c79a-524f-4aa7-ab3f-326301dce2ab tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-303ef9e9-6c44-44e5-9b01-2b9f2e703688-delete_snapshot" released by "delete_snapshot" :: held 3.919s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:07 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb818b8-a5ee-48e7-9765-768af8d83324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56a76fe-2870-4936-810b-f5ff88eee3bf', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4daf77cf-1cee-4243-bb3b-d29d323b36b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Volume volume-d56a76fe-2870-4936-810b-f5ff88eee3bf (d56a76fe-2870-4936-810b-f5ff88eee3bf): created successfully Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4daf77cf-1cee-4243-bb3b-d29d323b36b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Flow 'volume_create_manager' (e5f9acf2-3c97-4ada-ada2-d995f5c97fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-30e3ed95-abc3-4975-8a47-f3e01ebb30ce tempest-ProjectReaderTests-924709970 None] Created volume successfully. Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-853e877b-741e-4db0-bf95-e1935feedbe4-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-853e877b-741e-4db0-bf95-e1935feedbe4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-853e877b-741e-4db0-bf95-e1935feedbe4" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-853e877b-741e-4db0-bf95-e1935feedbe4" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9ccaf0-1c1b-4edb-95b1-9c94e3087240]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Acquiring lock "cinder-d56a76fe-2870-4936-810b-f5ff88eee3bf-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Lock "cinder-d56a76fe-2870-4936-810b-f5ff88eee3bf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Acquiring lock "cinder-quobyte-d56a76fe-2870-4936-810b-f5ff88eee3bf" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:07 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 Jul 08 01:38:07 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Lock "cinder-quobyte-d56a76fe-2870-4936-810b-f5ff88eee3bf" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[971c1ad4-363a-4ed1-8e0e-2022d5dd814d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:07 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf Jul 08 01:38:07 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:08 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4" returned: 0 in 0.795s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:08 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4 Jul 08 01:38:08 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:08 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf" returned: 0 in 0.785s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:08 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf Jul 08 01:38:08 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:08 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-853e877b-741e-4db0-bf95-e1935feedbe4" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-853e877b-741e-4db0-bf95-e1935feedbe4" released by "delete_volume" :: held 1.542s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Created reservations ['31233aba-324f-4d2a-93ea-6959a6480f96', '44c9aac7-ff75-4ed0-8567-899fba1fdcaa', '62201936-e518-43cb-bb7b-4b94a80a7887', 'd320e250-0e9f-4017-87e5-ccdd27c9cd1d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:09 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d56a76fe-2870-4936-810b-f5ff88eee3bf" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:09 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:09 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Lock "cinder-quobyte-d56a76fe-2870-4936-810b-f5ff88eee3bf" released by "delete_volume" :: held 1.531s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Created reservations ['74c84ab7-1b5c-478a-9369-611dca6bd96b', '02844933-5186-4eee-abde-005eae83ba46', 'b1409a07-b884-4982-be37-ec9f62525fb1', 'f017021d-1e85-4c60-9878-499aa3974f9a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:09 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:09 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:10 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.880s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Deleted volume successfully. Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1735f176-c9a1-43a8-b39e-5695281f641c tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-853e877b-741e-4db0-bf95-e1935feedbe4-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:10 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.879s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Deleted volume successfully. Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=77,cinder:INSERT=24,cinder:UPDATE=91,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebbe03a8-2719-4cb8-b1f4-d5d0b7371f6b tempest-ProjectReaderTests-924709970 None] Lock "cinder-d56a76fe-2870-4936-810b-f5ff88eee3bf-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=81,cinder:SELECT=85,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (bafe55ac-a855-411e-957d-8b7ec8548cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25f6e90-be51-4e51-9071-9821d60d47f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25f6e90-be51-4e51-9071-9821d60d47f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1594194302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a471cf-31db-4b95-be8c-d3624445cc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f394d904b54ef3b76aa55b12396d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:10Z,use_quota=True,user_id='95b6516d6ec24491accf7f9f29cf12fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3c7065-ed6f-4de8-a7ad-9a19616ee13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3c7065-ed6f-4de8-a7ad-9a19616ee13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4fc016-6bc4-409d-8c6e-7c772abb5676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4fc016-6bc4-409d-8c6e-7c772abb5676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a471cf-31db-4b95-be8c-d3624445cc04', 'volume_name': 'volume-78a471cf-31db-4b95-be8c-d3624445cc04', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641a3d52-c03b-4d57-8455-3d7435e079dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641a3d52-c03b-4d57-8455-3d7435e079dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58830a4-b934-41d2-903f-913735032431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Volume 78a471cf-31db-4b95-be8c-d3624445cc04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a471cf-31db-4b95-be8c-d3624445cc04', 'volume_size': 1} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1594194302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a471cf-31db-4b95-be8c-d3624445cc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f394d904b54ef3b76aa55b12396d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:10Z,use_quota=True,user_id='95b6516d6ec24491accf7f9f29cf12fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Creating volume 78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:10 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:38:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:10 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 1073741824 Jul 08 01:38:10 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:11 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 1073741824" returned: 0 in 1.049s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:11 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 Jul 08 01:38:11 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:12 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04" returned: 0 in 0.722s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58830a4-b934-41d2-903f-913735032431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a471cf-31db-4b95-be8c-d3624445cc04', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f8f18e-74e6-47dd-988d-eca89176f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Volume volume-78a471cf-31db-4b95-be8c-d3624445cc04 (78a471cf-31db-4b95-be8c-d3624445cc04): created successfully Jul 08 01:38:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f8f18e-74e6-47dd-988d-eca89176f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (bafe55ac-a855-411e-957d-8b7ec8548cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4d07bb59-196e-4f95-a699-41e7ecb8e54f tempest-VolumesSnapshotTestJSON-1218638142 None] Created volume successfully. Jul 08 01:38:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-91e2a93d-9564-49c4-b252-655034589f20 req-e4baae46-46ad-4ef3-b899-d57ad34100d3 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-91e2a93d-9564-49c4-b252-655034589f20 req-e4baae46-46ad-4ef3-b899-d57ad34100d3 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5216b-0c69-4f0e-8598-a6152e0948b8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-91e2a93d-9564-49c4-b252-655034589f20 req-e4baae46-46ad-4ef3-b899-d57ad34100d3 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:13 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 Jul 08 01:38:13 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:14 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-91e2a93d-9564-49c4-b252-655034589f20 req-e4baae46-46ad-4ef3-b899-d57ad34100d3 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3" returned: 0 in 0.872s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-91e2a93d-9564-49c4-b252-655034589f20 req-e4baae46-46ad-4ef3-b899-d57ad34100d3 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.893s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.541s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Creating offline snapshot 2abcfef3-8749-45d7-ab19-314c4a384d8a of volume 78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:38:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d65a013-13f2-4c23-9ed1-222fd9a466b9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-91e2a93d-9564-49c4-b252-655034589f20 req-e4baae46-46ad-4ef3-b899-d57ad34100d3 tempest-TestInstancesWithCinderVolumes-1513293405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5348be6e-fd14-45f2-bf7f-94a299bca2c9', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:38:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-91e2a93d-9564-49c4-b252-655034589f20 req-e4baae46-46ad-4ef3-b899-d57ad34100d3 tempest-TestInstancesWithCinderVolumes-1513293405 None] attachment_update completed successfully. Jul 08 01:38:14 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 Jul 08 01:38:14 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:15 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04" returned: 0 in 0.944s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:15 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a 1G Jul 08 01:38:15 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:16 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a 1G" returned: 0 in 0.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a471cf-31db-4b95-be8c-d3624445cc04 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:16 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a471cf-31db-4b95-be8c-d3624445cc04 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a Jul 08 01:38:16 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:16 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a471cf-31db-4b95-be8c-d3624445cc04 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a" returned: 0 in 0.771s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:16 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a is being set with open permissions: ugo+rw Jul 08 01:38:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:17 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a Jul 08 01:38:17 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:17 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a" returned: 0 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:17 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.info Jul 08 01:38:17 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:18 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.info" returned: 0 in 0.719s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:18 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.info is being set with open permissions: ugo+rw Jul 08 01:38:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:18 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.info Jul 08 01:38:18 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:19 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.info" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.042s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e64c1522-5cf4-4ef3-95b9-d630bd2e3875 tempest-VolumesSnapshotTestJSON-1218638142 None] Create snapshot completed successfully Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Flow 'volume_create_manager' (0cee507d-40a7-48f1-b8d2-20e7828d2943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77a2ed0-6323-4ec9-9ed3-1ce9d1a4dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77a2ed0-6323-4ec9-9ed3-1ce9d1a4dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200914539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02e149b7374771837a14abee51f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:20Z,use_quota=True,user_id='480be01d583047539c722b613c95a2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af3a72e-93aa-4182-aa20-d54f660b90e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af3a72e-93aa-4182-aa20-d54f660b90e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31b12b8-96e0-4295-a0aa-6b9b5d7c51c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31b12b8-96e0-4295-a0aa-6b9b5d7c51c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc', 'volume_name': 'volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5bc60a-0e8f-42ae-bc1d-506cde5b8c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5bc60a-0e8f-42ae-bc1d-506cde5b8c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc1655f-ea9d-401d-abc0-b0d7e18eaee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Volume 5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc', 'volume_size': 1} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200914539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02e149b7374771837a14abee51f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:20Z,use_quota=True,user_id='480be01d583047539c722b613c95a2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Creating volume 5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:20 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:20 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc 1073741824 Jul 08 01:38:20 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (1ea08701-323d-4205-a413-a78094b6d714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9690ee60-703b-4f0f-baac-104276f65493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9690ee60-703b-4f0f-baac-104276f65493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1951493182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee083b0-bc10-4573-a149-eecc2b6fdfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f394d904b54ef3b76aa55b12396d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2abcfef3-8749-45d7-ab19-314c4a384d8a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:21Z,use_quota=True,user_id='95b6516d6ec24491accf7f9f29cf12fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b57b97-adf4-499a-aef0-8508d5137d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b57b97-adf4-499a-aef0-8508d5137d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166fa62f-4049-4112-be07-3be20f2d16ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166fa62f-4049-4112-be07-3be20f2d16ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aee083b0-bc10-4573-a149-eecc2b6fdfcd', 'volume_name': 'volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd', 'volume_size': 1, 'snapshot_id': '2abcfef3-8749-45d7-ab19-314c4a384d8a'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ffd839-9773-4ed9-b136-ac8b9d84f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ffd839-9773-4ed9-b136-ac8b9d84f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efaf6c8-f072-4e82-a9d1-769d5fc8bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Volume aee083b0-bc10-4573-a149-eecc2b6fdfcd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd', 'volume_size': 1, 'snapshot_id': '2abcfef3-8749-45d7-ab19-314c4a384d8a'} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:21 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc 1073741824" returned: 0 in 0.992s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:21 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc Jul 08 01:38:21 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:21 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.826s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-2abcfef3-8749-45d7-ab19-314c4a384d8a-aee083b0-bc10-4573-a149-eecc2b6fdfcd" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc1655f-ea9d-401d-abc0-b0d7e18eaee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec91c7a-b891-4047-b1ae-9b97de067aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-2abcfef3-8749-45d7-ab19-314c4a384d8a-aee083b0-bc10-4573-a149-eecc2b6fdfcd" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Creating volume aee083b0-bc10-4573-a149-eecc2b6fdfcd from snapshot 2abcfef3-8749-45d7-ab19-314c4a384d8a {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-aee083b0-bc10-4573-a149-eecc2b6fdfcd" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Volume volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc (5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc): created successfully Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec91c7a-b891-4047-b1ae-9b97de067aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Flow 'volume_create_manager' (0cee507d-40a7-48f1-b8d2-20e7828d2943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-aee083b0-bc10-4573-a149-eecc2b6fdfcd" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] snapshot: 2abcfef3-8749-45d7-ab19-314c4a384d8a, volume: aee083b0-bc10-4573-a149-eecc2b6fdfcd, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:38:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-247bd9b5-2488-4662-97ef-435c457b960a tempest-ProjectReaderTests-973419756 None] Created volume successfully. Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ff1c22-240b-436e-82d4-5601fd52a241]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-6ad6ad33-fa62-4dec-8678-9305ac98372a req-99211a53-841e-48f8-8749-c4e1cbc1e6f2 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:22 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a Jul 08 01:38:22 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:22 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a" returned: 0 in 0.856s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78a471cf-31db-4b95-be8c-d3624445cc04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:38:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7b08dd-a67e-44e3-87a4-b41aaf2d6c62]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:23 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 Jul 08 01:38:23 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Acquiring lock "cinder-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Lock "cinder-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Acquiring lock "cinder-quobyte-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Lock "cinder-quobyte-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d865ab9-a25f-477b-9e13-f8bbde7b7bb8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:23 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc Jul 08 01:38:23 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:23 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04" returned: 0 in 0.945s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:23 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:38:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:23 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd Jul 08 01:38:23 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:24 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc" returned: 0 in 0.889s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:24 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc Jul 08 01:38:24 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:25 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc" returned: 0 in 1.545s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Lock "cinder-quobyte-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc" released by "delete_volume" :: held 2.513s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:26 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Created reservations ['3576765b-f9fb-49af-af51-834a30cc812c', 'a11edad2-252f-4bf5-a20b-d02e192d785d', '66aefdaf-e5fd-44f4-8b06-2aedaf85c415', '9a02ab07-7a8e-4c1c-90e9-6992217b543f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:26 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:26 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Flow 'volume_create_manager' (d3b41d9f-f509-4420-a361-c60be4727771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d9e3b5-da95-4e31-b48e-4a82e129338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d9e3b5-da95-4e31-b48e-4a82e129338d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895483424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f70af0d-eb37-474c-9ef3-73761d349dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02e149b7374771837a14abee51f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:28Z,use_quota=True,user_id='480be01d583047539c722b613c95a2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc5bd94-7944-4222-88e0-912e40008f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc5bd94-7944-4222-88e0-912e40008f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948c83a4-7375-431b-beac-826d01edd12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948c83a4-7375-431b-beac-826d01edd12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f70af0d-eb37-474c-9ef3-73761d349dbc', 'volume_name': 'volume-7f70af0d-eb37-474c-9ef3-73761d349dbc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12a9deb-87ed-4912-a3a8-e150bc49de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12a9deb-87ed-4912-a3a8-e150bc49de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7141b657-a1da-4a2d-929f-df4c249cb8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Volume 7f70af0d-eb37-474c-9ef3-73761d349dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f70af0d-eb37-474c-9ef3-73761d349dbc', 'volume_size': 1} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:28 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 2.615s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Deleted volume successfully. Jul 08 01:38:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-64c1f534-ac1c-4184-95b5-ba8c5d0e9fc1 tempest-ProjectReaderTests-973419756 None] Lock "cinder-5a61d7ce-235c-4c71-bcc5-cc4c812a5fbc-delete_volume" released by "delete_volume" :: held 5.539s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:29 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd" returned: 0 in 5.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[83338448-12dc-4db0-8d9a-589c25132d40]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:29 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 Jul 08 01:38:29 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:30 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04" returned: 0 in 0.978s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:30 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:38:30 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Converted 1024.00 MB image at 178.95 MB/s Jul 08 01:38:30 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd is being set with open permissions: ugo+rw Jul 08 01:38:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:30 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd Jul 08 01:38:30 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:31 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd" returned: 0 in 0.697s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-aee083b0-bc10-4573-a149-eecc2b6fdfcd" released by "_copy_volume_from_snapshot" :: held 9.322s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-2abcfef3-8749-45d7-ab19-314c4a384d8a-aee083b0-bc10-4573-a149-eecc2b6fdfcd" released by "_create_volume_from_snapshot" :: held 9.386s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.424s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-6ad6ad33-fa62-4dec-8678-9305ac98372a req-99211a53-841e-48f8-8749-c4e1cbc1e6f2 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.215s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[be10516e-4a05-4f0c-9c95-576f3f291ff6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-6ad6ad33-fa62-4dec-8678-9305ac98372a req-99211a53-841e-48f8-8749-c4e1cbc1e6f2 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efaf6c8-f072-4e82-a9d1-769d5fc8bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd', 'volume_size': 1, 'snapshot_id': '2abcfef3-8749-45d7-ab19-314c4a384d8a'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d860b38c-84a0-4e59-acab-1be18d8e8344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Volume volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd (aee083b0-bc10-4573-a149-eecc2b6fdfcd): created successfully Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d860b38c-84a0-4e59-acab-1be18d8e8344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Flow 'volume_create_manager' (1ea08701-323d-4205-a413-a78094b6d714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7821f24c-b07b-42ac-926d-8de79d3b886d tempest-VolumesSnapshotTestJSON-1218638142 None] Created volume successfully. Jul 08 01:38:31 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 Jul 08 01:38:31 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:32 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-6ad6ad33-fa62-4dec-8678-9305ac98372a req-99211a53-841e-48f8-8749-c4e1cbc1e6f2 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952" returned: 0 in 0.809s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-6ad6ad33-fa62-4dec-8678-9305ac98372a req-99211a53-841e-48f8-8749-c4e1cbc1e6f2 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.830s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.903s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895483424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f70af0d-eb37-474c-9ef3-73761d349dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02e149b7374771837a14abee51f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:28Z,use_quota=True,user_id='480be01d583047539c722b613c95a2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Creating volume 7f70af0d-eb37-474c-9ef3-73761d349dbc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:32 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:32 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc 1073741824 Jul 08 01:38:32 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-6ad6ad33-fa62-4dec-8678-9305ac98372a req-99211a53-841e-48f8-8749-c4e1cbc1e6f2 tempest-TestInstancesWithCinderVolumes-1513293405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-0bb0be6e-04ee-4d59-8374-4dd272453952', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71900b50-9fe2-4264-acad-b00ee5e54b99', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:38:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-6ad6ad33-fa62-4dec-8678-9305ac98372a req-99211a53-841e-48f8-8749-c4e1cbc1e6f2 tempest-TestInstancesWithCinderVolumes-1513293405 None] attachment_update completed successfully. Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-aee083b0-bc10-4573-a149-eecc2b6fdfcd-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-aee083b0-bc10-4573-a149-eecc2b6fdfcd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-aee083b0-bc10-4573-a149-eecc2b6fdfcd" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-aee083b0-bc10-4573-a149-eecc2b6fdfcd" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad52ba22-c4af-4192-afab-f4515f5e3cb4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:32 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd Jul 08 01:38:32 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:33 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc 1073741824" returned: 0 in 0.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:33 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc Jul 08 01:38:33 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:33 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd" returned: 0 in 0.979s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:33 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd Jul 08 01:38:33 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:33 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7141b657-a1da-4a2d-929f-df4c249cb8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f70af0d-eb37-474c-9ef3-73761d349dbc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa5a69a-2c6b-4a68-9251-9cd79ae66383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:34 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Volume volume-7f70af0d-eb37-474c-9ef3-73761d349dbc (7f70af0d-eb37-474c-9ef3-73761d349dbc): created successfully Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa5a69a-2c6b-4a68-9251-9cd79ae66383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Flow 'volume_create_manager' (d3b41d9f-f509-4420-a361-c60be4727771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bf6ce02f-acf5-4ad5-93e8-a0163a36fbc6 tempest-ProjectReaderTests-973419756 None] Created volume successfully. Jul 08 01:38:34 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-aee083b0-bc10-4573-a149-eecc2b6fdfcd" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-aee083b0-bc10-4573-a149-eecc2b6fdfcd" released by "delete_volume" :: held 1.782s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Created reservations ['09409c1b-8b41-4796-8904-7bd2cf9db99a', '2b5f919f-f91a-470b-befb-9eae4e8f44bb', 'd07bb39f-7354-406f-84d6-cd9300ec21e7', '532c3f03-1429-4182-b7cc-821d0443c80c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:34 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:34 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Acquiring lock "cinder-7f70af0d-eb37-474c-9ef3-73761d349dbc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Lock "cinder-7f70af0d-eb37-474c-9ef3-73761d349dbc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Acquiring lock "cinder-quobyte-7f70af0d-eb37-474c-9ef3-73761d349dbc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-2abcfef3-8749-45d7-ab19-314c4a384d8a-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-2abcfef3-8749-45d7-ab19-314c4a384d8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-78a471cf-31db-4b95-be8c-d3624445cc04" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Lock "cinder-quobyte-7f70af0d-eb37-474c-9ef3-73761d349dbc" acquired by "delete_volume" :: waited 0.058s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-78a471cf-31db-4b95-be8c-d3624445cc04" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-2abcfef3-8749-45d7-ab19-314c4a384d8a" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[be994a5c-e1f7-4c51-899e-bd03d00ce51e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-2abcfef3-8749-45d7-ab19-314c4a384d8a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Deleting offline snapshot 2abcfef3-8749-45d7-ab19-314c4a384d8a of volume 78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] snapshot_file for this snap is: volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:38:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecc986e-ac7d-4ef6-baef-a24a106019ce]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:35 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc Jul 08 01:38:35 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:35 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a Jul 08 01:38:35 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:35 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.825s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Deleted volume successfully. Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0bad4cc3-37f1-4d16-9003-4576b51c7eb3 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-aee083b0-bc10-4573-a149-eecc2b6fdfcd-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:35 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc" returned: 0 in 0.944s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:35 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc Jul 08 01:38:35 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a" returned: 0 in 0.917s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78a471cf-31db-4b95-be8c-d3624445cc04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:38:35 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d006392e-499c-4e51-8c56-868722f5d05e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:36 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 Jul 08 01:38:36 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:36 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7f70af0d-eb37-474c-9ef3-73761d349dbc" returned: 0 in 0.725s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Lock "cinder-quobyte-7f70af0d-eb37-474c-9ef3-73761d349dbc" released by "delete_volume" :: held 1.760s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Created reservations ['b709a5ed-23d3-4dbd-9415-4283571740be', 'bad8b83a-402c-43b7-b778-8bed3efb808b', 'e981262b-1018-4eb8-bd02-02c92121336c', '19287f35-ef09-4d94-a520-5cd246ade3de'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:36 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:36 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:36 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04" returned: 0 in 0.952s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:36 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a Jul 08 01:38:36 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Flow 'volume_create_manager' (06217d9e-5b41-411e-bbd2-4a2ff2644bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bd62fa-0482-4dec-931a-09db6bbaafd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bd62fa-0482-4dec-931a-09db6bbaafd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489805952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173626bf-5a99-4505-9237-04a4629b547c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02e149b7374771837a14abee51f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:38Z,use_quota=True,user_id='480be01d583047539c722b613c95a2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d16956-17e9-40b5-bf52-8da2f2e4f325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d16956-17e9-40b5-bf52-8da2f2e4f325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:37 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae86af01-a8d5-4a7d-9efa-5c11c6b3115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae86af01-a8d5-4a7d-9efa-5c11c6b3115c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173626bf-5a99-4505-9237-04a4629b547c', 'volume_name': 'volume-173626bf-5a99-4505-9237-04a4629b547c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ad4e64-5acd-4eda-b6c5-1a2b35110d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ad4e64-5acd-4eda-b6c5-1a2b35110d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65634e38-f4d5-47d6-9d99-e2b2d953c8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:37 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Volume 173626bf-5a99-4505-9237-04a4629b547c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173626bf-5a99-4505-9237-04a4629b547c', 'volume_size': 1} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489805952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173626bf-5a99-4505-9237-04a4629b547c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02e149b7374771837a14abee51f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:38Z,use_quota=True,user_id='480be01d583047539c722b613c95a2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Creating volume 173626bf-5a99-4505-9237-04a4629b547c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:37 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.147s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:37 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:37 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c 1073741824 Jul 08 01:38:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Deleted volume successfully. Jul 08 01:38:37 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63cff808-cd03-47cf-90f4-08b059ca8211 tempest-ProjectReaderTests-973419756 None] Lock "cinder-7f70af0d-eb37-474c-9ef3-73761d349dbc-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:38 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a" returned: 0 in 1.175s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:38 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a Jul 08 01:38:38 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:38 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04.2abcfef3-8749-45d7-ab19-314c4a384d8a" returned: 0 in 0.767s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-2abcfef3-8749-45d7-ab19-314c4a384d8a" released by "_delete_snapshot" :: held 3.954s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-78a471cf-31db-4b95-be8c-d3624445cc04" released by "delete_snapshot" :: held 4.000s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:38 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c 1073741824" returned: 0 in 0.986s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:39 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c Jul 08 01:38:39 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:39 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Created reservations ['aab83604-4de3-4674-bea2-d6d62e4e9202', '70b24fcf-b784-46ff-aedf-a3891d561bc1', '26fb5399-01db-477d-807b-adcbc920fa69', '32261059-b780-499b-a261-16ce1f146937'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Delete snapshot completed successfully. Jul 08 01:38:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-15888733-0608-49da-bd05-657f65b2352a tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-2abcfef3-8749-45d7-ab19-314c4a384d8a-delete_snapshot" released by "delete_snapshot" :: held 4.260s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:39 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c" returned: 0 in 0.753s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65634e38-f4d5-47d6-9d99-e2b2d953c8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173626bf-5a99-4505-9237-04a4629b547c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8506ad77-c3dd-481b-bc83-0b3251f49467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Volume volume-173626bf-5a99-4505-9237-04a4629b547c (173626bf-5a99-4505-9237-04a4629b547c): created successfully Jul 08 01:38:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8506ad77-c3dd-481b-bc83-0b3251f49467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Flow 'volume_create_manager' (06217d9e-5b41-411e-bbd2-4a2ff2644bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-dff538e0-87ec-426c-94c3-4b0ddff4c67c tempest-ProjectReaderTests-973419756 None] Created volume successfully. Jul 08 01:38:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-78a471cf-31db-4b95-be8c-d3624445cc04-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-78a471cf-31db-4b95-be8c-d3624445cc04-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-78a471cf-31db-4b95-be8c-d3624445cc04" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-78a471cf-31db-4b95-be8c-d3624445cc04" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b0f6b5-f6c2-4b9b-9c26-741c4058a1a8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:40 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 Jul 08 01:38:40 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Acquiring lock "cinder-173626bf-5a99-4505-9237-04a4629b547c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Lock "cinder-173626bf-5a99-4505-9237-04a4629b547c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Acquiring lock "cinder-quobyte-173626bf-5a99-4505-9237-04a4629b547c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Lock "cinder-quobyte-173626bf-5a99-4505-9237-04a4629b547c" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d8b490-202d-48c1-b53a-70b72a5b840d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:41 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c Jul 08 01:38:41 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:41 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04" returned: 0 in 0.877s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:41 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04 Jul 08 01:38:41 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:41 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-78a471cf-31db-4b95-be8c-d3624445cc04" returned: 0 in 0.705s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-78a471cf-31db-4b95-be8c-d3624445cc04" released by "delete_volume" :: held 1.643s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:42 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c" returned: 0 in 0.966s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Created reservations ['079bc753-19f4-4ed1-9efd-5f3979f922d0', 'ded29f91-65ab-42b7-8006-d1b3952dd00b', 'b43391fb-d257-4ac3-a04d-042133dc32c0', '1e1d44ac-8c3a-4ae4-ba24-fec79d81bcb7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:42 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c Jul 08 01:38:42 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-ee7f91e4-cfe3-4b5c-b1f2-6e2a9f8c6478 req-190af3d6-9e8f-45e2-9f08-ea788c215e1f tempest-TestInstancesWithCinderVolumes-1513293405 None] Terminate volume connection completed successfully. Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ee7f91e4-cfe3-4b5c-b1f2-6e2a9f8c6478 req-190af3d6-9e8f-45e2-9f08-ea788c215e1f tempest-TestInstancesWithCinderVolumes-1513293405 None] Deleting attachment 5348be6e-fd14-45f2-bf7f-94a299bca2c9. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:38:42 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:42 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-d70db9c0-0652-409a-b331-b041e0d65921-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-d70db9c0-0652-409a-b331-b041e0d65921-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "cinder-quobyte-d70db9c0-0652-409a-b331-b041e0d65921" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-d70db9c0-0652-409a-b331-b041e0d65921" acquired by "delete_volume" :: waited 0.042s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce82d37-7795-441f-ac78-d051a00a8efb]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:42 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-173626bf-5a99-4505-9237-04a4629b547c" returned: 0 in 0.812s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Lock "cinder-quobyte-173626bf-5a99-4505-9237-04a4629b547c" released by "delete_volume" :: held 1.835s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:42 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 Jul 08 01:38:42 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Created reservations ['9138fcb4-72a5-4a37-998c-818b656e5298', '5e5558c1-edaf-4021-bcf8-fdeb8da533b3', '6cd8767c-7474-4bc2-a82c-82d6868334f8', '2b1e666b-3289-47d5-bb13-2257e664cafd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:42 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.803s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:42 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Deleted volume successfully. Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2efdd820-721a-4a0f-8bb2-f849e67cafcd tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-78a471cf-31db-4b95-be8c-d3624445cc04-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:43 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:43 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:43 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921" returned: 0 in 0.916s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:43 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921 Jul 08 01:38:43 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:43 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.728s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Deleted volume successfully. Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Flow 'volume_create_manager' (d305c746-8c81-43a7-869f-22de81df5b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54702b9f-aeb0-453c-8bce-8dd78bddca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0f2a14d-eb23-4cab-bcb7-baae7b8eda50 tempest-ProjectReaderTests-973419756 None] Lock "cinder-173626bf-5a99-4505-9237-04a4629b547c-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54702b9f-aeb0-453c-8bce-8dd78bddca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210333984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5703a1-fd25-4ef4-a0ef-f7654db076fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02e149b7374771837a14abee51f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:44Z,use_quota=True,user_id='480be01d583047539c722b613c95a2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b731978a-f27e-48e7-8e20-90289c3febdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b731978a-f27e-48e7-8e20-90289c3febdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5fd571-5ce1-4bae-a646-caa1f4e78949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5fd571-5ce1-4bae-a646-caa1f4e78949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5703a1-fd25-4ef4-a0ef-f7654db076fc', 'volume_name': 'volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06234c18-b497-4f19-983e-9c7d371b1f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06234c18-b497-4f19-983e-9c7d371b1f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5531a78a-18ab-4798-977c-e7854555081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Volume ea5703a1-fd25-4ef4-a0ef-f7654db076fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc', 'volume_size': 1} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210333984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5703a1-fd25-4ef4-a0ef-f7654db076fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02e149b7374771837a14abee51f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:44Z,use_quota=True,user_id='480be01d583047539c722b613c95a2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Creating volume ea5703a1-fd25-4ef4-a0ef-f7654db076fc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:43 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:38:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:43 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc 1073741824 Jul 08 01:38:43 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "cinder-94fb4b9e-883d-49ec-8278-16a3f00bf8f3-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-94fb4b9e-883d-49ec-8278-16a3f00bf8f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "cinder-quobyte-94fb4b9e-883d-49ec-8278-16a3f00bf8f3" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-quobyte-94fb4b9e-883d-49ec-8278-16a3f00bf8f3" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1377d7d-481c-4dea-9fcd-00587442368d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:44 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 Jul 08 01:38:44 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:44 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-d70db9c0-0652-409a-b331-b041e0d65921" returned: 0 in 0.780s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-quobyte-d70db9c0-0652-409a-b331-b041e0d65921" released by "delete_volume" :: held 1.800s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Created reservations ['5aff880c-16bd-4b87-ad22-96c0518c3760', 'e6f54fac-b24b-40e9-a9ed-c81626151091', 'cc3d1c08-6aaf-4498-bda5-cba096f239db', '4f420665-f285-4d29-8d17-804369f71383'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:44 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:44 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:45 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc 1073741824" returned: 0 in 1.089s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:45 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc Jul 08 01:38:45 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:45 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:45 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3 Jul 08 01:38:45 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:45 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.142s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:45 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Deleted volume successfully. Jul 08 01:38:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d342a872-be75-4a54-8e3b-9828766685d0 tempest-VolumesSnapshotTestJSON-1218638142 None] Lock "cinder-d70db9c0-0652-409a-b331-b041e0d65921-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:46 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-94fb4b9e-883d-49ec-8278-16a3f00bf8f3" returned: 0 in 0.926s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-quobyte-94fb4b9e-883d-49ec-8278-16a3f00bf8f3" released by "delete_volume" :: held 1.948s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:46 devstack cinder-volume[87204]: WARNING cinder.quota [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-309129968-356589842 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-309129968-356589842, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:38:46 devstack cinder-volume[87204]: WARNING cinder.quota [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-309129968-356589842 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-309129968-356589842, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Created reservations ['4f05c400-3f6c-4a61-b680-e0cdf00999a2', '57f79f97-b57c-46f8-a6ab-f4f5269be1d0', '809cb742-f885-4482-b5db-0edc1eee06de', '10fcb746-86a8-4406-bb8f-2ccbf2241bf4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:46 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc" returned: 0 in 1.194s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5531a78a-18ab-4798-977c-e7854555081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5337b2-f473-4b42-af44-fa71b92949a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Volume volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc (ea5703a1-fd25-4ef4-a0ef-f7654db076fc): created successfully Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5337b2-f473-4b42-af44-fa71b92949a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:46 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:46 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Flow 'volume_create_manager' (d305c746-8c81-43a7-869f-22de81df5b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e59bf679-2168-47af-937e-be4e16dd16cb tempest-ProjectReaderTests-973419756 None] Created volume successfully. Jul 08 01:38:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Acquiring lock "cinder-ea5703a1-fd25-4ef4-a0ef-f7654db076fc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Lock "cinder-ea5703a1-fd25-4ef4-a0ef-f7654db076fc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Acquiring lock "cinder-quobyte-ea5703a1-fd25-4ef4-a0ef-f7654db076fc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Lock "cinder-quobyte-ea5703a1-fd25-4ef4-a0ef-f7654db076fc" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:47 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.889s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:47 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[90740902-87e0-42cf-87ef-af5e5101f2ee]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Deleted volume successfully. Jul 08 01:38:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2f50085-15f5-4e07-8bdd-5e55420af6ff tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-94fb4b9e-883d-49ec-8278-16a3f00bf8f3-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:47 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc Jul 08 01:38:47 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:48 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc" returned: 0 in 0.905s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:48 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc Jul 08 01:38:48 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:48 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ea5703a1-fd25-4ef4-a0ef-f7654db076fc" returned: 0 in 0.860s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Lock "cinder-quobyte-ea5703a1-fd25-4ef4-a0ef-f7654db076fc" released by "delete_volume" :: held 1.818s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:49 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Created reservations ['25d07480-d45d-476b-8b59-d56c0c122c37', '878a198e-a278-41a4-bb02-ac7b0ffc86ed', '7be8367b-f7f2-46c1-963d-56737f536690', '1f6fa74b-0d7a-4991-966e-70bce00a00b2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:49 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:49 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-988314d4-efaa-451b-a8bc-365a8bc55123 req-63f3a063-194f-4c00-a079-b9a67abce239 tempest-TestInstancesWithCinderVolumes-1513293405 None] Terminate volume connection completed successfully. Jul 08 01:38:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-988314d4-efaa-451b-a8bc-365a8bc55123 req-63f3a063-194f-4c00-a079-b9a67abce239 tempest-TestInstancesWithCinderVolumes-1513293405 None] Deleting attachment 71900b50-9fe2-4264-acad-b00ee5e54b99. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:38:50 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.916s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:50 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Deleted volume successfully. Jul 08 01:38:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b4e6c98-57f9-47e8-92e8-80042b2fdf54 tempest-ProjectReaderTests-973419756 None] Lock "cinder-ea5703a1-fd25-4ef4-a0ef-f7654db076fc-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "cinder-0bb0be6e-04ee-4d59-8374-4dd272453952-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-0bb0be6e-04ee-4d59-8374-4dd272453952-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "cinder-quobyte-0bb0be6e-04ee-4d59-8374-4dd272453952" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-quobyte-0bb0be6e-04ee-4d59-8374-4dd272453952" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0536ac-a61c-40b8-8aa7-aff4feaf8586]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:52 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 Jul 08 01:38:52 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:53 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952" returned: 0 in 1.084s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:53 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952 Jul 08 01:38:53 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:53 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:53 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:53 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0bb0be6e-04ee-4d59-8374-4dd272453952" returned: 0 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-quobyte-0bb0be6e-04ee-4d59-8374-4dd272453952" released by "delete_volume" :: held 1.960s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:53 devstack cinder-volume[87204]: WARNING cinder.quota [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1091479902-2058302914 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1091479902-2058302914, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:38:53 devstack cinder-volume[87204]: WARNING cinder.quota [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1091479902-2058302914 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1091479902-2058302914, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:38:53 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Created reservations ['8029165b-372b-4348-9f7e-b291a8eefa76', 'dc8a173a-84ba-46ea-9052-65a855646a76', '2d3765d5-afa0-48d2-a234-88a5f23dea03', '4be729ec-61a7-4f38-9477-f5b0efb6b474'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:54 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:38:54 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:54 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.953s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:38:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:38:55 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.914s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Deleted volume successfully. Jul 08 01:38:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-102364df-de19-4b3d-83b9-f3185172c848 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-0bb0be6e-04ee-4d59-8374-4dd272453952-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:04 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=99,cinder:SELECT=76,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:05 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=99,cinder:SELECT=82,cinder:INSERT=19,cinder:DELETE=10 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-afdb0dca-18bd-400f-a126-d8f10a69bf35 req-89381646-d7e0-48a5-a0e4-e6e40e1c30d0 tempest-TestInstancesWithCinderVolumes-1513293405 None] Terminate volume connection completed successfully. Jul 08 01:39:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-afdb0dca-18bd-400f-a126-d8f10a69bf35 req-89381646-d7e0-48a5-a0e4-e6e40e1c30d0 tempest-TestInstancesWithCinderVolumes-1513293405 None] Deleting attachment ef97b939-2c2a-4c0e-90a6-bf0e74ff3456. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:39:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "cinder-00b2fedc-8402-442c-b245-a165bdb28640-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-00b2fedc-8402-442c-b245-a165bdb28640-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "cinder-quobyte-00b2fedc-8402-442c-b245-a165bdb28640" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-quobyte-00b2fedc-8402-442c-b245-a165bdb28640" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42ee64e-0628-42db-90a3-2c0ba63801f8]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:11 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 Jul 08 01:39:11 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:12 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640" returned: 0 in 0.981s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:12 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 Jul 08 01:39:12 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:13 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640" returned: 1 in 1.160s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:39:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:13 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640 Jul 08 01:39:13 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:14 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00b2fedc-8402-442c-b245-a165bdb28640" returned: 0 in 0.891s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-quobyte-00b2fedc-8402-442c-b245-a165bdb28640" released by "delete_volume" :: held 3.161s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:14 devstack cinder-volume[87204]: WARNING cinder.quota [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777866871-2071324963 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777866871-2071324963, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:39:14 devstack cinder-volume[87204]: WARNING cinder.quota [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777866871-2071324963 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777866871-2071324963, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:39:14 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Created reservations ['805dd1c8-2fa3-4648-8da1-bddd8b8b8777', '21e943dc-38c4-419c-96c3-8e2c1715342a', '6338aaeb-22b3-49f9-9937-97d3221812f4', '56d3524c-0b70-4139-a5ce-3c45103c77c2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:14 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:39:14 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:15 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Deleted volume successfully. Jul 08 01:39:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-68461c6b-a0bc-424d-afa1-1c19062dddc7 tempest-TestInstancesWithCinderVolumes-1513293405 None] Lock "cinder-00b2fedc-8402-442c-b245-a165bdb28640-delete_volume" released by "delete_volume" :: held 4.373s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Flow 'volume_create_manager' (a13a7f60-9d20-4db0-89c5-bbd5407d60bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878d2821-0323-4e74-86fa-2d6a20f06606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878d2821-0323-4e74-86fa-2d6a20f06606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1336570819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b650c8-b733-428d-9fff-87c3707b3aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216fce182bd34054835579fa8a8b4abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:29Z,use_quota=True,user_id='a2305e7a82f84a4eb42e5d4f69128062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa320ab-73c7-4187-87ca-9aaa82e455aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa320ab-73c7-4187-87ca-9aaa82e455aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e296ff1-f30f-410c-9d19-d40106670398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e296ff1-f30f-410c-9d19-d40106670398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b650c8-b733-428d-9fff-87c3707b3aa8', 'volume_name': 'volume-98b650c8-b733-428d-9fff-87c3707b3aa8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f787a8-6433-43e8-b321-dc7b8f2dc295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f787a8-6433-43e8-b321-dc7b8f2dc295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73af1c68-2760-4ee2-bd65-5c975d1a3778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Volume 98b650c8-b733-428d-9fff-87c3707b3aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b650c8-b733-428d-9fff-87c3707b3aa8', 'volume_size': 1} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1336570819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b650c8-b733-428d-9fff-87c3707b3aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216fce182bd34054835579fa8a8b4abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:29Z,use_quota=True,user_id='a2305e7a82f84a4eb42e5d4f69128062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Creating volume 98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:29 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:39:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:29 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 1073741824 Jul 08 01:39:29 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:30 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 1073741824" returned: 0 in 1.038s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:30 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 Jul 08 01:39:30 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:31 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73af1c68-2760-4ee2-bd65-5c975d1a3778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b650c8-b733-428d-9fff-87c3707b3aa8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41b32ea-8462-48e6-a9eb-26d7425cde8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Volume volume-98b650c8-b733-428d-9fff-87c3707b3aa8 (98b650c8-b733-428d-9fff-87c3707b3aa8): created successfully Jul 08 01:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41b32ea-8462-48e6-a9eb-26d7425cde8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Flow 'volume_create_manager' (a13a7f60-9d20-4db0-89c5-bbd5407d60bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0a8103fb-bbcb-44fb-9d69-9be8ef236dac tempest-SnapshotDependencyTests-1805888238 None] Created volume successfully. Jul 08 01:39:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Creating offline snapshot ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 of volume 98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:39:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb50b67-b149-4959-9bb0-e804505842c7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:32 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 Jul 08 01:39:32 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:33 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8" returned: 0 in 0.933s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:33 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 1G Jul 08 01:39:33 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:34 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 1G" returned: 0 in 1.180s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b650c8-b733-428d-9fff-87c3707b3aa8 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:34 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b650c8-b733-428d-9fff-87c3707b3aa8 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 Jul 08 01:39:34 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:35 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b650c8-b733-428d-9fff-87c3707b3aa8 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9" returned: 0 in 0.966s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:35 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 is being set with open permissions: ugo+rw Jul 08 01:39:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:35 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 Jul 08 01:39:35 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:36 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9" returned: 0 in 0.821s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:36 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.info Jul 08 01:39:36 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:37 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.info" returned: 0 in 0.884s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:37 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.info is being set with open permissions: ugo+rw Jul 08 01:39:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:37 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.info Jul 08 01:39:37 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:38 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.info" returned: 0 in 0.739s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.667s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a5ad8654-68bc-476b-8fa8-4f2ac1ec86ff tempest-SnapshotDependencyTests-1805888238 None] Create snapshot completed successfully Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Flow 'volume_create_manager' (9f844056-8d02-4478-95a0-db1fa82114c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb96dfea-a811-4a12-aea6-cf9a55232daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb96dfea-a811-4a12-aea6-cf9a55232daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3e4066-fb16-49b5-9e7f-389025dd50b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216fce182bd34054835579fa8a8b4abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:40Z,use_quota=True,user_id='a2305e7a82f84a4eb42e5d4f69128062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a596403-7dee-4d3b-bc71-f4205ee24cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a596403-7dee-4d3b-bc71-f4205ee24cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c661c6-d098-4a5c-b6aa-9433b764bf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c661c6-d098-4a5c-b6aa-9433b764bf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b3e4066-fb16-49b5-9e7f-389025dd50b1', 'volume_name': 'volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1', 'volume_size': 1, 'snapshot_id': 'ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32546c67-2a44-4b40-ac6e-1c31c33dfe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32546c67-2a44-4b40-ac6e-1c31c33dfe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db260e70-609c-41b8-8a6e-2c3498fa5af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Volume 3b3e4066-fb16-49b5-9e7f-389025dd50b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1', 'volume_size': 1, 'snapshot_id': 'ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9'} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "cinder-quobyte-ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9-3b3e4066-fb16-49b5-9e7f-389025dd50b1" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9-3b3e4066-fb16-49b5-9e7f-389025dd50b1" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Creating volume 3b3e4066-fb16-49b5-9e7f-389025dd50b1 from snapshot ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "cinder-quobyte-3b3e4066-fb16-49b5-9e7f-389025dd50b1" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-3b3e4066-fb16-49b5-9e7f-389025dd50b1" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] snapshot: ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9, volume: 3b3e4066-fb16-49b5-9e7f-389025dd50b1, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63f65a-0bc9-4ff4-baf9-efb697db9064]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:40 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 Jul 08 01:39:40 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:41 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9" returned: 0 in 1.049s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98b650c8-b733-428d-9fff-87c3707b3aa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:39:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:39:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:39:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b2b52f-5def-4f05-ba8e-c2baa426d90e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:41 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 Jul 08 01:39:41 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:42 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8" returned: 0 in 0.981s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:42 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:39:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:42 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 Jul 08 01:39:42 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:50 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:50 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:50 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1" returned: 0 in 7.869s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[48131bad-550e-4e95-83bc-9ec3c55075e6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:50 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 Jul 08 01:39:50 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Flow 'volume_create_manager' (7e02c222-ae85-45c3-80ce-c46be9ce09b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1221c1-651b-4913-894c-9094a500e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1221c1-651b-4913-894c-9094a500e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-435350733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37b8435-9a5b-489b-b562-e62a4a26bb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effeafe79bce47b1b05d96bcbfb45332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:51Z,use_quota=True,user_id='9e6dbe5a63cc4313b9c992ddefc63aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11c44e7-72d0-404c-9222-51d9d6cb7cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11c44e7-72d0-404c-9222-51d9d6cb7cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617d2c77-5592-423d-9b11-31558b595279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617d2c77-5592-423d-9b11-31558b595279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37b8435-9a5b-489b-b562-e62a4a26bb4c', 'volume_name': 'volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a52276-8623-4dd6-9c0d-07e62e766f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a52276-8623-4dd6-9c0d-07e62e766f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6746c170-f7a5-40d2-81dc-9d500fdc2cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Volume f37b8435-9a5b-489b-b562-e62a4a26bb4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c', 'volume_size': 1} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:51 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8" returned: 0 in 1.629s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8, size 1024.00 MB, duration 7.87 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:39:51 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Converted 1024.00 MB image at 130.09 MB/s Jul 08 01:39:51 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 is being set with open permissions: ugo+rw Jul 08 01:39:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:51 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 Jul 08 01:39:51 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:52 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1" returned: 0 in 0.876s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-3b3e4066-fb16-49b5-9e7f-389025dd50b1" released by "_copy_volume_from_snapshot" :: held 12.574s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9-3b3e4066-fb16-49b5-9e7f-389025dd50b1" released by "_create_volume_from_snapshot" :: held 12.649s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.691s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-435350733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37b8435-9a5b-489b-b562-e62a4a26bb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effeafe79bce47b1b05d96bcbfb45332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:51Z,use_quota=True,user_id='9e6dbe5a63cc4313b9c992ddefc63aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Creating volume f37b8435-9a5b-489b-b562-e62a4a26bb4c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:52 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:52 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c 1073741824 Jul 08 01:39:52 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db260e70-609c-41b8-8a6e-2c3498fa5af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1', 'volume_size': 1, 'snapshot_id': 'ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a66b824-f27a-46f4-8fc0-2d43c6eb6dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Volume volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 (3b3e4066-fb16-49b5-9e7f-389025dd50b1): created successfully Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a66b824-f27a-46f4-8fc0-2d43c6eb6dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Flow 'volume_create_manager' (9f844056-8d02-4478-95a0-db1fa82114c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4d74e8a0-f761-4424-ad87-c748a848d872 tempest-SnapshotDependencyTests-1805888238 None] Created volume successfully. Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:53 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:39:53 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "cinder-ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "cinder-quobyte-98b650c8-b733-428d-9fff-87c3707b3aa8" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-98b650c8-b733-428d-9fff-87c3707b3aa8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "cinder-quobyte-ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Deleting offline snapshot ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 of volume 98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:39:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] snapshot_file for this snap is: volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:39:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff45054-a7de-440f-94de-9bb127dba26c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:54 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:54 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 Jul 08 01:39:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c 1073741824" returned: 0 in 1.510s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:54 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:54 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c Jul 08 01:39:54 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:55 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.488s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:39:55 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c" returned: 0 in 1.048s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] <== create_volume: return (2694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.702s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6746c170-f7a5-40d2-81dc-9d500fdc2cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:55 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c32b957-60a8-497e-9f38-7f8c62411121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9" returned: 0 in 1.444s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98b650c8-b733-428d-9fff-87c3707b3aa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[898317c7-2f4c-42ad-8e7c-82e341f04141]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:55 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Volume volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c (f37b8435-9a5b-489b-b562-e62a4a26bb4c): created successfully Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c32b957-60a8-497e-9f38-7f8c62411121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Flow 'volume_create_manager' (7e02c222-ae85-45c3-80ce-c46be9ce09b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bd70f33c-128f-4dac-bdad-0433ab64fba2 tempest-TestMinimumBasicScenario-994923287 None] Created volume successfully. Jul 08 01:39:55 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 Jul 08 01:39:55 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:56 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8" returned: 0 in 0.934s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:56 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 Jul 08 01:39:56 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:57 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9" returned: 0 in 1.056s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:57 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9 Jul 08 01:39:57 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:58 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8.ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9" returned: 0 in 0.860s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9" released by "_delete_snapshot" :: held 4.446s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-98b650c8-b733-428d-9fff-87c3707b3aa8" released by "delete_snapshot" :: held 4.477s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:58 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Created reservations ['1af158c5-979a-4952-b904-9162c17a59a2', '65e7bcf7-3ec9-4181-a27d-74b6a65adbb1', '6736c81c-54c3-47b1-89ef-37df25ef6552', 'da448b9e-16ea-4abc-9686-479e87ff4a7b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Delete snapshot completed successfully. Jul 08 01:39:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84f1461b-5709-4905-aa73-762e45523857 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-ac457e9b-2eb2-47b4-b1f7-8e0eb09506f9-delete_snapshot" released by "delete_snapshot" :: held 4.669s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "cinder-98b650c8-b733-428d-9fff-87c3707b3aa8-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-98b650c8-b733-428d-9fff-87c3707b3aa8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "cinder-quobyte-98b650c8-b733-428d-9fff-87c3707b3aa8" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-98b650c8-b733-428d-9fff-87c3707b3aa8" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c090cbc-7716-48de-aa21-a6d7fdd63005]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:59 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 Jul 08 01:39:59 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-bc3b417a-a8ba-457e-af07-5700d2b56f38 req-e2522937-9619-4874-8d57-70e81f9055bd tempest-TestMinimumBasicScenario-994923287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-bc3b417a-a8ba-457e-af07-5700d2b56f38 req-e2522937-9619-4874-8d57-70e81f9055bd tempest-TestMinimumBasicScenario-994923287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dde400d-303e-4039-9366-b1a5fc12444a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-bc3b417a-a8ba-457e-af07-5700d2b56f38 req-e2522937-9619-4874-8d57-70e81f9055bd tempest-TestMinimumBasicScenario-994923287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:00 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c Jul 08 01:40:00 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:00 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8" returned: 0 in 1.078s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:00 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8 Jul 08 01:40:00 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:01 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-bc3b417a-a8ba-457e-af07-5700d2b56f38 req-e2522937-9619-4874-8d57-70e81f9055bd tempest-TestMinimumBasicScenario-994923287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c" returned: 0 in 1.042s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-bc3b417a-a8ba-457e-af07-5700d2b56f38 req-e2522937-9619-4874-8d57-70e81f9055bd tempest-TestMinimumBasicScenario-994923287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.067s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:01 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-98b650c8-b733-428d-9fff-87c3707b3aa8" returned: 0 in 0.873s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-98b650c8-b733-428d-9fff-87c3707b3aa8" released by "delete_volume" :: held 2.022s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-bc3b417a-a8ba-457e-af07-5700d2b56f38 req-e2522937-9619-4874-8d57-70e81f9055bd tempest-TestMinimumBasicScenario-994923287 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b50a835b-f4a6-4d41-9cb0-7efdcbd80a5f', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Created reservations ['b563857e-83ba-45a1-90c2-d134b34042a4', 'b176ded9-d3b2-4eb7-887e-9d732052e561', '7b3b2b85-d0ca-4b6c-bebf-758382fa8dde', '6cbbdefb-1455-49df-9ea4-a79af7b27eb7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-bc3b417a-a8ba-457e-af07-5700d2b56f38 req-e2522937-9619-4874-8d57-70e81f9055bd tempest-TestMinimumBasicScenario-994923287 None] attachment_update completed successfully. Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:01 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:40:01 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:02 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.818s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:02 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Deleted volume successfully. Jul 08 01:40:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-476f5996-a0d9-43b4-b81f-25867f39d697 tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-98b650c8-b733-428d-9fff-87c3707b3aa8-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "cinder-3b3e4066-fb16-49b5-9e7f-389025dd50b1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-3b3e4066-fb16-49b5-9e7f-389025dd50b1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "cinder-quobyte-3b3e4066-fb16-49b5-9e7f-389025dd50b1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-3b3e4066-fb16-49b5-9e7f-389025dd50b1" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d05e825-daf1-4e99-aed5-e6812677af6b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:03 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 Jul 08 01:40:03 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:03 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1" returned: 0 in 0.852s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:03 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1 Jul 08 01:40:03 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:04 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3b3e4066-fb16-49b5-9e7f-389025dd50b1" returned: 0 in 0.792s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-quobyte-3b3e4066-fb16-49b5-9e7f-389025dd50b1" released by "delete_volume" :: held 1.725s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:04 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Created reservations ['aa295ebe-03b0-4d2f-903f-b5d86634590c', '659dbb6c-edf4-4679-89d0-6ec0f53f5ff3', '316fe1ab-cf18-4f2f-a9f0-161593cb9376', 'acb4045a-677c-4a9e-b223-0840cf840d98'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:04 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:40:04 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:05 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.994s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:05 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Deleted volume successfully. Jul 08 01:40:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ecdd942-6bfe-4f0d-926f-13834a3f387d tempest-SnapshotDependencyTests-1805888238 None] Lock "cinder-3b3e4066-fb16-49b5-9e7f-389025dd50b1-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:14 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=21,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:40:15 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Flow 'volume_create_manager' (b7fb48fe-6588-46d4-882e-0adf5d399a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bc728b-f029-4c25-b3b0-2c0c4e603e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bc728b-f029-4c25-b3b0-2c0c4e603e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1383766523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a652cd7a-eac0-4970-834c-2cc742bee609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8faf101f4843c8855facf7beae37ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:40:51Z,use_quota=True,user_id='75cee3956e66481c892294381a7124af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4850bad3-9f25-4c90-9953-c80529388790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4850bad3-9f25-4c90-9953-c80529388790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6103bca3-32c8-4a80-9b1b-c3143521a8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6103bca3-32c8-4a80-9b1b-c3143521a8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a652cd7a-eac0-4970-834c-2cc742bee609', 'volume_name': 'volume-a652cd7a-eac0-4970-834c-2cc742bee609', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4117155-7fef-4e98-8f9e-4577f133d100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4117155-7fef-4e98-8f9e-4577f133d100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452cc4d6-f1ed-4db7-810d-dfb88de77507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Volume a652cd7a-eac0-4970-834c-2cc742bee609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a652cd7a-eac0-4970-834c-2cc742bee609', 'volume_size': 1} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1383766523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a652cd7a-eac0-4970-834c-2cc742bee609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8faf101f4843c8855facf7beae37ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:40:51Z,use_quota=True,user_id='75cee3956e66481c892294381a7124af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Creating volume a652cd7a-eac0-4970-834c-2cc742bee609 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:40:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:50 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 1073741824 Jul 08 01:40:50 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:51 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 1073741824" returned: 0 in 0.961s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:51 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 Jul 08 01:40:51 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:52 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609" returned: 0 in 0.812s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:40:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452cc4d6-f1ed-4db7-810d-dfb88de77507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a652cd7a-eac0-4970-834c-2cc742bee609', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8815db-7beb-4abc-abff-bc94c517340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Volume volume-a652cd7a-eac0-4970-834c-2cc742bee609 (a652cd7a-eac0-4970-834c-2cc742bee609): created successfully Jul 08 01:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8815db-7beb-4abc-abff-bc94c517340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Flow 'volume_create_manager' (b7fb48fe-6588-46d4-882e-0adf5d399a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-84e28527-fe02-45a1-8936-03d7e6c88cc2 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Created volume successfully. Jul 08 01:40:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:40:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:53 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:40:53 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:54 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:40:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:40:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-7bef33b2-f365-4134-b550-62c7b0fb9d3d req-0c714b55-60f1-4e1d-b8cb-5be61c2670c1 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-7bef33b2-f365-4134-b550-62c7b0fb9d3d req-0c714b55-60f1-4e1d-b8cb-5be61c2670c1 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b7ee3e-a7cc-4929-b98a-3be899364770]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-7bef33b2-f365-4134-b550-62c7b0fb9d3d req-0c714b55-60f1-4e1d-b8cb-5be61c2670c1 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:56 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 Jul 08 01:40:56 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:57 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-7bef33b2-f365-4134-b550-62c7b0fb9d3d req-0c714b55-60f1-4e1d-b8cb-5be61c2670c1 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609" returned: 0 in 1.073s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-7bef33b2-f365-4134-b550-62c7b0fb9d3d req-0c714b55-60f1-4e1d-b8cb-5be61c2670c1 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.093s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-7bef33b2-f365-4134-b550-62c7b0fb9d3d req-0c714b55-60f1-4e1d-b8cb-5be61c2670c1 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-a652cd7a-eac0-4970-834c-2cc742bee609', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3738dfd-0cde-4b65-b7ef-28356fdb096e', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:40:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-7bef33b2-f365-4134-b550-62c7b0fb9d3d req-0c714b55-60f1-4e1d-b8cb-5be61c2670c1 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] attachment_update completed successfully. Jul 08 01:40:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-91695cf0-82a6-4afe-b45c-d62e0657e6c0 req-15b43f0b-639c-42ec-ac2c-373e8a027d31 tempest-TestMinimumBasicScenario-994923287 None] Terminate volume connection completed successfully. Jul 08 01:40:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-91695cf0-82a6-4afe-b45c-d62e0657e6c0 req-15b43f0b-639c-42ec-ac2c-373e8a027d31 tempest-TestMinimumBasicScenario-994923287 None] Deleting attachment b50a835b-f4a6-4d41-9cb0-7efdcbd80a5f. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:41:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Acquiring lock "cinder-f37b8435-9a5b-489b-b562-e62a4a26bb4c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Lock "cinder-f37b8435-9a5b-489b-b562-e62a4a26bb4c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Acquiring lock "cinder-quobyte-f37b8435-9a5b-489b-b562-e62a4a26bb4c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Lock "cinder-quobyte-f37b8435-9a5b-489b-b562-e62a4a26bb4c" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefa3fd-98e5-4c95-b063-4d6d0f82814e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:02 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c Jul 08 01:41:02 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:02 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c" returned: 0 in 0.956s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:02 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c Jul 08 01:41:02 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:03 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-f37b8435-9a5b-489b-b562-e62a4a26bb4c" returned: 0 in 0.691s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Lock "cinder-quobyte-f37b8435-9a5b-489b-b562-e62a4a26bb4c" released by "delete_volume" :: held 1.692s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:03 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Created reservations ['fe1d58fb-bce7-42be-833d-f8a21f6183ea', '9a0194b9-6742-4887-a3dd-24419f973fd7', 'e3a81645-ec0b-46dc-a275-5a146934fabf', 'eb06265f-3b17-468d-b73d-f4da22ee4640'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:03 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:41:03 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-11b75052-0658-4d89-8791-1e52d6994e21 req-5a79ae9d-5297-4891-9937-1220f93896e3 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Terminate volume connection completed successfully. Jul 08 01:41:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-11b75052-0658-4d89-8791-1e52d6994e21 req-5a79ae9d-5297-4891-9937-1220f93896e3 tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Deleting attachment f3738dfd-0cde-4b65-b7ef-28356fdb096e. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:41:04 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:04 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Deleted volume successfully. Jul 08 01:41:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6cf1a34d-bf06-4056-a52d-bfe30b2b4557 tempest-TestMinimumBasicScenario-994923287 None] Lock "cinder-f37b8435-9a5b-489b-b562-e62a4a26bb4c-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Acquiring lock "cinder-a652cd7a-eac0-4970-834c-2cc742bee609-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "cinder-a652cd7a-eac0-4970-834c-2cc742bee609-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Acquiring lock "cinder-quobyte-a652cd7a-eac0-4970-834c-2cc742bee609" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "cinder-quobyte-a652cd7a-eac0-4970-834c-2cc742bee609" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c3ed31-541b-42a7-8f62-0223525e5107]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:06 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 Jul 08 01:41:06 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:07 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:07 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609 Jul 08 01:41:07 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:08 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a652cd7a-eac0-4970-834c-2cc742bee609" returned: 0 in 0.684s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "cinder-quobyte-a652cd7a-eac0-4970-834c-2cc742bee609" released by "delete_volume" :: held 1.607s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Created reservations ['3c014a71-4c3b-4611-bcdb-2bc2fd9d3e28', '8981c195-fad9-483f-8e42-cef65f24697a', '6f020083-192c-4d2f-a167-0a3c9db84d7c', '26261fec-d8e8-42ef-8c1d-389d8292b5ff'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:08 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:41:08 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:09 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.723s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Deleted volume successfully. Jul 08 01:41:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e766cf-6192-4d47-ab8d-f49d2e4b00ce tempest-TestServerVolumeAttachScenarioOldVersion-860717114 None] Lock "cinder-a652cd7a-eac0-4970-834c-2cc742bee609-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=22,cinder:SELECT=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:41:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=21,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Flow 'volume_create_manager' (4779ba58-c820-4261-a377-fc19106539ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9231a9e1-d3d2-4904-9f39-a129840be15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9231a9e1-d3d2-4904-9f39-a129840be15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1230004949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4f6c6a-299c-4f5d-8bab-ba48e7877c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff9db59f5724b2580f653584c90f4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:30Z,use_quota=True,user_id='9abfeae00c7143d3aa923598f886ade9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f72773-f6b2-4874-8522-bfd3f6eea581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f72773-f6b2-4874-8522-bfd3f6eea581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d9c9ca-7c44-4d26-9f7c-47392982d758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d9c9ca-7c44-4d26-9f7c-47392982d758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4f6c6a-299c-4f5d-8bab-ba48e7877c04', 'volume_name': 'volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854a1a9f-b846-4dfe-aa80-58ee87da7b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854a1a9f-b846-4dfe-aa80-58ee87da7b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bb0d68-2706-4917-88f6-b5b9d9d19e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Volume 1d4f6c6a-299c-4f5d-8bab-ba48e7877c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04', 'volume_size': 1} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1230004949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4f6c6a-299c-4f5d-8bab-ba48e7877c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff9db59f5724b2580f653584c90f4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:30Z,use_quota=True,user_id='9abfeae00c7143d3aa923598f886ade9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Creating volume 1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:30 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:30 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 1073741824 Jul 08 01:41:30 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:31 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 1073741824" returned: 0 in 1.122s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:31 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 Jul 08 01:41:31 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:32 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" returned: 0 in 0.829s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:41:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bb0d68-2706-4917-88f6-b5b9d9d19e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a921ad-91d8-4188-9ea2-e187394b7d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Volume volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 (1d4f6c6a-299c-4f5d-8bab-ba48e7877c04): created successfully Jul 08 01:41:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a921ad-91d8-4188-9ea2-e187394b7d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Flow 'volume_create_manager' (4779ba58-c820-4261-a377-fc19106539ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e85827f2-b939-4fec-99ae-a7af17c41331 tempest-VolumeDependencyTests-1494085034 None] Created volume successfully. Jul 08 01:41:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Creating offline snapshot fe83d62a-c2a0-44c7-a178-6154b571a521 of volume 1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:41:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc62013-426d-4359-a223-e1a7d5996d51]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:34 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 Jul 08 01:41:34 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:34 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" returned: 0 in 0.902s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:34 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 1G Jul 08 01:41:34 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:35 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 1G" returned: 0 in 0.973s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:35 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 Jul 08 01:41:35 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:36 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:36 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 is being set with open permissions: ugo+rw Jul 08 01:41:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:36 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 Jul 08 01:41:36 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:37 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:37 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.info Jul 08 01:41:37 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:38 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.info" returned: 0 in 0.777s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:38 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.info is being set with open permissions: ugo+rw Jul 08 01:41:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:38 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.info Jul 08 01:41:38 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:39 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.info" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.213s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2312b410-9633-4c0c-8601-a24be3ed8ea8 tempest-VolumeDependencyTests-1494085034 None] Create snapshot completed successfully Jul 08 01:41:40 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Flow 'volume_create_manager' (87c47699-d937-4672-87df-e6714c141068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4b971a-c5d1-4f4d-89d7-c918d1810db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4b971a-c5d1-4f4d-89d7-c918d1810db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1144610154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9a63b6-e11d-4f1d-8dbc-357845f87943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff9db59f5724b2580f653584c90f4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe83d62a-c2a0-44c7-a178-6154b571a521,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:41Z,use_quota=True,user_id='9abfeae00c7143d3aa923598f886ade9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944c511e-1d50-4713-9ba8-221294535d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944c511e-1d50-4713-9ba8-221294535d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22e2e92-1bb3-4e77-bae5-4a26dbc72342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22e2e92-1bb3-4e77-bae5-4a26dbc72342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb9a63b6-e11d-4f1d-8dbc-357845f87943', 'volume_name': 'volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943', 'volume_size': 1, 'snapshot_id': 'fe83d62a-c2a0-44c7-a178-6154b571a521'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed556978-0a24-4a49-93ae-b9d977dcc0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed556978-0a24-4a49-93ae-b9d977dcc0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bf1885-cbe9-42d4-90b4-f91cb7e3b11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Volume eb9a63b6-e11d-4f1d-8dbc-357845f87943: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943', 'volume_size': 1, 'snapshot_id': 'fe83d62a-c2a0-44c7-a178-6154b571a521'} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "cinder-quobyte-fe83d62a-c2a0-44c7-a178-6154b571a521-eb9a63b6-e11d-4f1d-8dbc-357845f87943" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-fe83d62a-c2a0-44c7-a178-6154b571a521-eb9a63b6-e11d-4f1d-8dbc-357845f87943" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Creating volume eb9a63b6-e11d-4f1d-8dbc-357845f87943 from snapshot fe83d62a-c2a0-44c7-a178-6154b571a521 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "cinder-quobyte-eb9a63b6-e11d-4f1d-8dbc-357845f87943" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-eb9a63b6-e11d-4f1d-8dbc-357845f87943" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] snapshot: fe83d62a-c2a0-44c7-a178-6154b571a521, volume: eb9a63b6-e11d-4f1d-8dbc-357845f87943, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2defc85c-28e6-491f-aaa9-62e082cc56df]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:41 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 Jul 08 01:41:41 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:42 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521" returned: 0 in 0.960s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:41:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:41:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:41:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f4103a-5ec6-442a-b364-c9357e8a5cac]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:42 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 Jul 08 01:41:42 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:43 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" returned: 0 in 0.985s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:43 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:41:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:43 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 Jul 08 01:41:43 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:49 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943" returned: 0 in 5.999s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85407c9-5c58-40eb-904e-46cd2a5031f2]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:49 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 Jul 08 01:41:49 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:50 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" returned: 0 in 1.076s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:41:50 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Converted 1024.00 MB image at 170.64 MB/s Jul 08 01:41:50 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 is being set with open permissions: ugo+rw Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:50 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 Jul 08 01:41:50 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:50 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943" returned: 0 in 0.646s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-eb9a63b6-e11d-4f1d-8dbc-357845f87943" released by "_copy_volume_from_snapshot" :: held 9.783s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-fe83d62a-c2a0-44c7-a178-6154b571a521-eb9a63b6-e11d-4f1d-8dbc-357845f87943" released by "_create_volume_from_snapshot" :: held 9.815s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.831s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bf1885-cbe9-42d4-90b4-f91cb7e3b11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943', 'volume_size': 1, 'snapshot_id': 'fe83d62a-c2a0-44c7-a178-6154b571a521'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc1b061-df05-4cc3-bd8f-075582b21e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Volume volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 (eb9a63b6-e11d-4f1d-8dbc-357845f87943): created successfully Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc1b061-df05-4cc3-bd8f-075582b21e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Flow 'volume_create_manager' (87c47699-d937-4672-87df-e6714c141068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-79807d7e-4c23-4135-ba1b-76b51cccc07c tempest-VolumeDependencyTests-1494085034 None] Created volume successfully. Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "cinder-fe83d62a-c2a0-44c7-a178-6154b571a521-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-fe83d62a-c2a0-44c7-a178-6154b571a521-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "cinder-quobyte-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "cinder-quobyte-fe83d62a-c2a0-44c7-a178-6154b571a521" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-fe83d62a-c2a0-44c7-a178-6154b571a521" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Deleting offline snapshot fe83d62a-c2a0-44c7-a178-6154b571a521 of volume 1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] snapshot_file for this snap is: volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecb4a1f-c68f-4ab4-aa8a-fe7ce606994b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:51 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 Jul 08 01:41:51 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:52 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521" returned: 0 in 0.852s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f4e27b-23b4-41e0-a554-73e7941ec59c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:52 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 Jul 08 01:41:52 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Flow 'volume_create_manager' (4507ecb0-65f3-419f-967b-c82baa550e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d9001a-2fc6-49b4-9743-1fc08e5a5eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d9001a-2fc6-49b4-9743-1fc08e5a5eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1333816287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654d39fb-4b49-4d29-bc25-ad7e31ca8afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cbd474ae07f479384d46652ea92ca31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:53Z,use_quota=True,user_id='86f427fd88624930b7a200422eee4ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0d232e-74fc-4bdf-bcec-ad94fecddf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0d232e-74fc-4bdf-bcec-ad94fecddf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd218497-8b70-472b-8ea0-cebed30e4fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:52 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd218497-8b70-472b-8ea0-cebed30e4fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '654d39fb-4b49-4d29-bc25-ad7e31ca8afb', 'volume_name': 'volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:53 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca1029d-9cb9-4fd1-aa41-f80f3151d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca1029d-9cb9-4fd1-aa41-f80f3151d087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e15fad7-c4d3-40a9-a8ee-7c4d8a37bff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Volume 654d39fb-4b49-4d29-bc25-ad7e31ca8afb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Trying to clone 654d39fb-4b49-4d29-bc25-ad7e31ca8afb from image 32b92798-e800-4287-a1ac-3d0d0779a37d at location (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" returned: 0 in 0.918s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:53 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 Jul 08 01:41:53 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:41:53 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ad1c1d-fa11-4997-85e4-ded3cd093caa]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:53 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:41:53 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD Jul 08 01:41:53 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:53 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:54 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521" returned: 0 in 0.947s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:54 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521 Jul 08 01:41:54 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:54 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.751s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:41:54 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Temporary image 32b92798-e800-4287-a1ac-3d0d0779a37d is fetched for user 86f427fd88624930b7a200422eee4ac3. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2484d1bd-7657-4ec5-b3b2-0dcba1263385]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:54 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD Jul 08 01:41:54 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:54 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04.fe83d62a-c2a0-44c7-a178-6154b571a521" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-fe83d62a-c2a0-44c7-a178-6154b571a521" released by "_delete_snapshot" :: held 3.627s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" released by "delete_snapshot" :: held 3.657s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:54 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Created reservations ['18a31a90-799f-485c-a869-69250332b826', '7ddee468-0c05-44bd-b82e-5ceaf4e222b4', '99ce83ae-65de-4950-b5c2-fefe05d036ac', '0da6c727-bf76-4ab5-8388-437d48a772f8'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Delete snapshot completed successfully. Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-369ce407-5173-4fac-ba48-689172833e7b tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-fe83d62a-c2a0-44c7-a178-6154b571a521-delete_snapshot" released by "delete_snapshot" :: held 3.838s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:55 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1333816287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654d39fb-4b49-4d29-bc25-ad7e31ca8afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cbd474ae07f479384d46652ea92ca31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:53Z,use_quota=True,user_id='86f427fd88624930b7a200422eee4ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Creating volume 654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:55 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:55 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb 1073741824 Jul 08 01:41:55 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "cinder-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "cinder-quobyte-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[897e4d83-dd01-4beb-ab02-a8e5fea0d893]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:55 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 Jul 08 01:41:55 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:56 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb 1073741824" returned: 0 in 0.846s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:56 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:41:56 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:56 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:56 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04 Jul 08 01:41:56 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:56 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 0 in 0.728s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Attempting download of 32b92798-e800-4287-a1ac-3d0d0779a37d ((None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}])) to volume 654d39fb-4b49-4d29-bc25-ad7e31ca8afb. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f5515d-4fca-4fc5-b3fc-64f33a58a966]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_urpmb6re {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:57 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_urpmb6re Jul 08 01:41:57 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:57 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04" released by "delete_volume" :: held 1.698s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Created reservations ['3453605a-79c0-466c-b72c-baafd9fa1568', '02986f91-c853-4c0f-a993-cda6779de74a', 'a4113586-da92-4cc9-80c7-2f3f1651f436', '9057a6d8-0a59-41f2-b195-979d4fbb6b84'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:57 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:41:57 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "cinder-eb9a63b6-e11d-4f1d-8dbc-357845f87943-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:57 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_urpmb6re" returned: 0 in 0.785s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_urpmb6re {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-eb9a63b6-e11d-4f1d-8dbc-357845f87943-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "cinder-quobyte-eb9a63b6-e11d-4f1d-8dbc-357845f87943" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-eb9a63b6-e11d-4f1d-8dbc-357845f87943" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6107c5-90a6-4fa7-ab29-1ff9130a5adf]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:58 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_urpmb6re Jul 08 01:41:58 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:58 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 Jul 08 01:41:58 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:58 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.851s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:58 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Deleted volume successfully. Jul 08 01:41:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-182db4ce-ed44-4713-a74f-5ab3bcdff2b8 tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-1d4f6c6a-299c-4f5d-8bab-ba48e7877c04-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:58 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_urpmb6re" returned: 1 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32b92798-e800-4287-a1ac-3d0d0779a37d_urpmb6re' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:41:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfac91c-695b-4ba9-9671-55f598d91116]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:58 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD Jul 08 01:41:58 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:59 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943" returned: 0 in 1.069s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:59 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943 Jul 08 01:41:59 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:59 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD" returned: 0 in 0.916s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] 32b92798-e800-4287-a1ac-3d0d0779a37d was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:59 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:41:59 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:59 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-eb9a63b6-e11d-4f1d-8dbc-357845f87943" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-quobyte-eb9a63b6-e11d-4f1d-8dbc-357845f87943" released by "delete_volume" :: held 1.863s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Created reservations ['db85aba3-21f2-4fee-b8c9-807f71dbf737', 'be994fb6-76d5-43f1-b466-c736cb7dbb63', '360b6f0e-48dd-4886-ace1-ffffca11b47a', '0e385f87-0339-4457-abc2-99e49cda1f17'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:00 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:42:00 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:00 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.712s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:00 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:42:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Deleted volume successfully. Jul 08 01:42:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2dd57ddf-62fd-4039-af1e-cbca0cda484e tempest-VolumeDependencyTests-1494085034 None] Lock "cinder-eb9a63b6-e11d-4f1d-8dbc-357845f87943-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:01 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 0 in 2.234s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:01 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32b92798-e800-4287-a1ac-3d0d0779a37d_zwp2qom_devstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:42:01 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Converted 112.00 MB image at 50.09 MB/s Jul 08 01:42:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:01 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb 1G Jul 08 01:42:01 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:02 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb 1G" returned: 0 in 0.834s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e5788e-7755-4519-9adb-c2f6bfb7c1e9]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:02 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:42:02 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:03 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:03 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:42:03 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Flow 'volume_create_manager' (87325761-e99a-43f2-87fe-bdea80701553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1c8239-fb7e-492f-bbf4-578889cd5cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1c8239-fb7e-492f-bbf4-578889cd5cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3bff5c-6f92-491f-b8f8-463086232480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c664d70970c24f1da053abc997205612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:04Z,use_quota=True,user_id='5b917647dd06435d8677d8547d5c170c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f32c880-817e-4e66-bc08-d256f5f53f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f32c880-817e-4e66-bc08-d256f5f53f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac342da-8fa9-485f-a7ec-28af81cce811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac342da-8fa9-485f-a7ec-28af81cce811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b3bff5c-6f92-491f-b8f8-463086232480', 'volume_name': 'volume-9b3bff5c-6f92-491f-b8f8-463086232480', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e065be0e-4034-4623-b105-e30580104f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e065be0e-4034-4623-b105-e30580104f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e1d11d-3c3a-41d2-9fc4-4e4177bfca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Volume 9b3bff5c-6f92-491f-b8f8-463086232480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b3bff5c-6f92-491f-b8f8-463086232480', 'volume_size': 1} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3bff5c-6f92-491f-b8f8-463086232480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c664d70970c24f1da053abc997205612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:04Z,use_quota=True,user_id='5b917647dd06435d8677d8547d5c170c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Creating volume 9b3bff5c-6f92-491f-b8f8-463086232480 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:42:03 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:03 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480 1073741824 Jul 08 01:42:03 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:04 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 1 in 0.863s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Downloaded image 32b92798-e800-4287-a1ac-3d0d0779a37d ((None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}])) to volume 654d39fb-4b49-4d29-bc25-ad7e31ca8afb successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Temporary image 32b92798-e800-4287-a1ac-3d0d0779a37d for user 86f427fd88624930b7a200422eee4ac3 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Marking volume 654d39fb-4b49-4d29-bc25-ad7e31ca8afb as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Copying metadata from image 32b92798-e800-4287-a1ac-3d0d0779a37d to 654d39fb-4b49-4d29-bc25-ad7e31ca8afb. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Creating volume glance metadata for volume 654d39fb-4b49-4d29-bc25-ad7e31ca8afb backed by image 32b92798-e800-4287-a1ac-3d0d0779a37d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e15fad7-c4d3-40a9-a8ee-7c4d8a37bff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb', 'volume_size': 1, 'image_id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32b92798-e800-4287-a1ac-3d0d0779a37d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2376674d692b4cc1a9b9ce8235370147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '32b92798-e800-4287-a1ac-3d0d0779a37d', 'created_at': datetime.datetime(2026, 7, 7, 23, 13, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 13, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32b92798-e800-4287-a1ac-3d0d0779a37d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada5cdf5-1f02-44ae-8e9e-e93a305b5e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Volume volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb (654d39fb-4b49-4d29-bc25-ad7e31ca8afb): created successfully Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada5cdf5-1f02-44ae-8e9e-e93a305b5e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Flow 'volume_create_manager' (4507ecb0-65f3-419f-967b-c82baa550e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ca413579-9132-4cab-b03e-da365f5431bb tempest-TestShelveInstance-1302866909 None] Created volume successfully. Jul 08 01:42:04 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480 1073741824" returned: 0 in 0.930s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:04 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480 Jul 08 01:42:04 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:05 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480" returned: 0 in 0.651s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:42:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e1d11d-3c3a-41d2-9fc4-4e4177bfca4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3bff5c-6f92-491f-b8f8-463086232480', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cfc7f5-fa92-4401-89cd-fc96cfd2a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Volume volume-9b3bff5c-6f92-491f-b8f8-463086232480 (9b3bff5c-6f92-491f-b8f8-463086232480): created successfully Jul 08 01:42:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cfc7f5-fa92-4401-89cd-fc96cfd2a43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Flow 'volume_create_manager' (87325761-e99a-43f2-87fe-bdea80701553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-35653c48-a179-43a5-9263-370c76513e1d tempest-CinderUnicodeTest-2004498007 None] Created volume successfully. Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Flow 'volume_create_manager' (114f8eb4-3a9b-4571-b669-09e6c0f93be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcdff3e-31d0-4629-bc6d-fd1b72639e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcdff3e-31d0-4629-bc6d-fd1b72639e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1559715057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2685d4f7-0f74-4728-ac68-d3dfa24fdbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c664d70970c24f1da053abc997205612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:06Z,use_quota=True,user_id='5b917647dd06435d8677d8547d5c170c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9afad3-81cb-4b81-9eb6-5c1988e27847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9afad3-81cb-4b81-9eb6-5c1988e27847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b993322-9023-4839-9d86-d39aa7c086ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b993322-9023-4839-9d86-d39aa7c086ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2685d4f7-0f74-4728-ac68-d3dfa24fdbcf', 'volume_name': 'volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411ee3ce-ddea-4604-b65b-522b88ad067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411ee3ce-ddea-4604-b65b-522b88ad067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5088f55f-5f5e-471c-a9c0-452cb44fdead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:06 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Volume 2685d4f7-0f74-4728-ac68-d3dfa24fdbcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf', 'volume_size': 1} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1559715057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2685d4f7-0f74-4728-ac68-d3dfa24fdbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c664d70970c24f1da053abc997205612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:06Z,use_quota=True,user_id='5b917647dd06435d8677d8547d5c170c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Creating volume 2685d4f7-0f74-4728-ac68-d3dfa24fdbcf {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:42:06 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:06 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf 1073741824 Jul 08 01:42:06 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:07 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf 1073741824" returned: 0 in 0.947s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:07 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf Jul 08 01:42:07 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:08 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" returned: 0 in 0.707s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5088f55f-5f5e-471c-a9c0-452cb44fdead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548470e9-8fde-47ab-81de-6348acbdfa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Volume volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf (2685d4f7-0f74-4728-ac68-d3dfa24fdbcf): created successfully Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548470e9-8fde-47ab-81de-6348acbdfa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Flow 'volume_create_manager' (114f8eb4-3a9b-4571-b669-09e6c0f93be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b675f8c7-4666-4259-8b28-47de3bef760a tempest-CinderUnicodeTest-2004498007 None] Created volume successfully. Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Creating offline snapshot dfb26803-f2fa-4dad-8792-98893e6dc99a of volume 2685d4f7-0f74-4728-ac68-d3dfa24fdbcf {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b16456b-ad16-4829-9dc5-7fb7088a56c8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:09 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf Jul 08 01:42:09 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:09 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" returned: 0 in 0.803s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:09 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a 1G Jul 08 01:42:09 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:10 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a 1G" returned: 0 in 0.926s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:10 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a Jul 08 01:42:10 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:11 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:11 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a is being set with open permissions: ugo+rw Jul 08 01:42:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:11 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a Jul 08 01:42:11 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:12 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a" returned: 0 in 0.696s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:12 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.info Jul 08 01:42:12 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:13 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.info" returned: 0 in 0.878s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:13 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.info is being set with open permissions: ugo+rw Jul 08 01:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:13 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.info Jul 08 01:42:13 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.info" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:13 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.973s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.533s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e35b8cb7-3789-410b-8a88-bd10ea9c8155 tempest-CinderUnicodeTest-2004498007 None] Create snapshot completed successfully Jul 08 01:42:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb404d0-9d0c-4ac3-b9d2-422a9b4aefa7]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:14 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:42:14 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "cinder-dfb26803-f2fa-4dad-8792-98893e6dc99a-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-dfb26803-f2fa-4dad-8792-98893e6dc99a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "cinder-quobyte-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-quobyte-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "cinder-quobyte-dfb26803-f2fa-4dad-8792-98893e6dc99a" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-quobyte-dfb26803-f2fa-4dad-8792-98893e6dc99a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Deleting offline snapshot dfb26803-f2fa-4dad-8792-98893e6dc99a of volume 2685d4f7-0f74-4728-ac68-d3dfa24fdbcf {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] snapshot_file for this snap is: volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[822b1445-e623-4ae5-99d4-8114dea01d62]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:14 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a Jul 08 01:42:14 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:14 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 0 in 0.947s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:15 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:42:15 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:15 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a" returned: 0 in 0.876s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:42:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ebc134-5497-49b4-9628-5268c6ce85d7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:15 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf Jul 08 01:42:15 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:15 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 1 in 0.840s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.880s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c63455e-a450-414e-bd3a-56909f63f35c', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:42:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-60f33415-23b9-4be9-a587-3ddcb585765d req-c7d719e0-6486-4001-b15d-6f734bb8957d tempest-TestShelveInstance-1302866909 None] attachment_update completed successfully. Jul 08 01:42:16 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" returned: 0 in 0.900s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:16 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a Jul 08 01:42:16 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:16 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a" returned: 0 in 0.814s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:16 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a Jul 08 01:42:16 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:17 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf.dfb26803-f2fa-4dad-8792-98893e6dc99a" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-quobyte-dfb26803-f2fa-4dad-8792-98893e6dc99a" released by "_delete_snapshot" :: held 3.468s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-quobyte-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" released by "delete_snapshot" :: held 3.499s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:17 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Created reservations ['7e4cab88-4920-406c-bf4b-2bc2666c1b32', '7742b3a6-466d-41ba-b82c-c755eca64c02', 'bf99650e-9899-48c0-a391-f3322de13d17', 'babeeb45-35d6-42f1-a505-c0be793163f7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:42:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Delete snapshot completed successfully. Jul 08 01:42:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-08f7ab33-2cd4-4d4d-9e6d-07c5e29b8924 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-dfb26803-f2fa-4dad-8792-98893e6dc99a-delete_snapshot" released by "delete_snapshot" :: held 3.661s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "cinder-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:42:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:42:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "cinder-quobyte-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:42:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-quobyte-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:42:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ad4ee6-8106-4aa8-9347-16edecdcfef0]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:18 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf Jul 08 01:42:18 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:19 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" returned: 0 in 1.046s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:19 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf Jul 08 01:42:19 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:20 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-quobyte-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf" released by "delete_volume" :: held 1.951s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Created reservations ['6867fd2f-a144-4d5a-84ae-8aa455beb61a', 'be3b9509-d446-4fe3-b464-e8383603dd0e', 'b467852d-b86b-4d46-95a3-c293b19f023e', '46dbbbdd-7e8f-4b8b-b4b0-b700f5d1945b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:20 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:42:20 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "cinder-9b3bff5c-6f92-491f-b8f8-463086232480-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-9b3bff5c-6f92-491f-b8f8-463086232480-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "cinder-quobyte-9b3bff5c-6f92-491f-b8f8-463086232480" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-quobyte-9b3bff5c-6f92-491f-b8f8-463086232480" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b925ffc4-efcb-40ef-990f-98b28acb685d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:20 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480 Jul 08 01:42:20 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:21 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:21 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:42:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Deleted volume successfully. Jul 08 01:42:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b517ade1-18a4-41ad-8dae-cf4bdc1f0cf4 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-2685d4f7-0f74-4728-ac68-d3dfa24fdbcf-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:21 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480" returned: 0 in 0.915s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:21 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480 Jul 08 01:42:21 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:22 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9b3bff5c-6f92-491f-b8f8-463086232480" returned: 0 in 0.764s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-quobyte-9b3bff5c-6f92-491f-b8f8-463086232480" released by "delete_volume" :: held 1.728s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:22 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Created reservations ['e10c7ac0-ad7e-419a-86fe-ef01b366f533', '381b6360-78d1-4544-9ae2-9ee309482a76', '92b434c0-61f6-4502-a57c-454aaeb74183', '053cc985-f1be-4d9e-85a1-cacd97b0857a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:22 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:42:22 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:23 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.898s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:23 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:42:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Deleted volume successfully. Jul 08 01:42:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-58a8b522-5914-49f3-9c91-ad65532ac7f9 tempest-CinderUnicodeTest-2004498007 None] Lock "cinder-9b3bff5c-6f92-491f-b8f8-463086232480-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:32 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=62,cinder:SELECT=64,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:42:33 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=59,cinder:UPDATE=64,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:42:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:53 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:42:53 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-0396b094-0b7c-4c84-93e6-6f02cf8e7f6d req-47a753b8-7bb5-4be9-b9c2-568f6065371d tempest-TestShelveInstance-1302866909 None] Terminate volume connection completed successfully. Jul 08 01:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-0396b094-0b7c-4c84-93e6-6f02cf8e7f6d req-47a753b8-7bb5-4be9-b9c2-568f6065371d tempest-TestShelveInstance-1302866909 None] Deleting attachment 7c63455e-a450-414e-bd3a-56909f63f35c. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:42:54 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.717s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:42:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:42:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:42:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:42:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4485befc-705b-45ef-ac04-86ee509c7db9]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:58 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:42:58 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:59 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 0 in 0.808s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:59 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:42:59 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:00 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 1 in 0.856s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.702s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb', 'name': 'volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fb935fa-f09b-4383-a23b-14cd26644f10', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:43:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-0dbae794-029c-48a2-a7a9-a9d2b466b357 req-9d0f6e44-608d-4624-8f31-fcea4d8aa9c7 tempest-TestShelveInstance-1302866909 None] attachment_update completed successfully. Jul 08 01:43:10 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:10 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-e3590cbe-05b3-445f-8449-18acac8364a9 tempest-TestShelveInstance-1302866909 None] Terminate volume connection completed successfully. Jul 08 01:43:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-e3590cbe-05b3-445f-8449-18acac8364a9 tempest-TestShelveInstance-1302866909 None] Deleting attachment 7fb935fa-f09b-4383-a23b-14cd26644f10. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:43:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Acquiring lock "cinder-654d39fb-4b49-4d29-bc25-ad7e31ca8afb-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Lock "cinder-654d39fb-4b49-4d29-bc25-ad7e31ca8afb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Acquiring lock "cinder-quobyte-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Lock "cinder-quobyte-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ae2214-e944-451d-b817-2541d12f44fb]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:39 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:43:39 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:40 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:40 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:43:40 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:40 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 1 in 0.814s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:43:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:40 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb Jul 08 01:43:40 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:41 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" returned: 0 in 0.672s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Lock "cinder-quobyte-654d39fb-4b49-4d29-bc25-ad7e31ca8afb" released by "delete_volume" :: held 2.340s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:41 devstack cinder-volume[87204]: DEBUG cinder.quota [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Created reservations ['e5647bd6-53bc-4954-98b3-48d7eb5f5cb2', '539cf35c-2775-4bfa-b757-4f67cc339029', '80b44bf4-7267-4fd3-9774-a03bc59cdc16', '341b21be-82b8-4b06-9cde-91cabed9f907'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:43:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:41 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:43:41 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:42 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.725s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:42 devstack cinder-volume[87204]: DEBUG cinder.manager [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Deleted volume successfully. Jul 08 01:43:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-58fec040-1fa9-4a0b-b00a-d97eeb5a8637 req-650ccf67-ccce-44e7-a4e6-b3699f066507 tempest-TestShelveInstance-1302866909 None] Lock "cinder-654d39fb-4b49-4d29-bc25-ad7e31ca8afb-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:51 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:52 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:43:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:53 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:43:53 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:54 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:43:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:43:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Flow 'volume_create_manager' (40181e41-e10f-480a-af75-d4aca36e4d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac001304-fabb-4061-ab47-5f69a8fe6fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac001304-fabb-4061-ab47-5f69a8fe6fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9e4ad3-5636-413e-bdd8-23126287b3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86e7281734243fbac11d90ddaf803cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:58Z,use_quota=True,user_id='fe56e4ced24a4f01b699f88e0dd29170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49ed704d-b3a3-45de-b81b-187a456a3539),volume_type_id=49ed704d-b3a3-45de-b81b-187a456a3539)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af1369a-3248-47f7-858a-4279d852ff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af1369a-3248-47f7-858a-4279d852ff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90549782-ee84-4125-9645-ca798b6ef3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90549782-ee84-4125-9645-ca798b6ef3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da9e4ad3-5636-413e-bdd8-23126287b3be', 'volume_name': 'volume-da9e4ad3-5636-413e-bdd8-23126287b3be', 'volume_size': 1, 'image_id': 'f6cc1815-69cc-4136-9021-9ac976bc7ece', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6cc1815-69cc-4136-9021-9ac976bc7ece', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95f9cbdb83475b395787c01426430b14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c86e7281734243fbac11d90ddaf803cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0831bd6825d231d225627ca7ae6761d01bb699050afecc2a0f9e2e1c028b3a3dba91c8fd497389b85f36d1b5966d2bb7492c6e29428f9d30544ad89783975c33', 'id': 'f6cc1815-69cc-4136-9021-9ac976bc7ece', 'created_at': datetime.datetime(2026, 7, 7, 23, 43, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 43, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6cc1815-69cc-4136-9021-9ac976bc7ece/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fed680e-1afd-4dd8-87cd-f649f996933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fed680e-1afd-4dd8-87cd-f649f996933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75000fd2-e59e-47e0-b975-732246e595ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Volume da9e4ad3-5636-413e-bdd8-23126287b3be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da9e4ad3-5636-413e-bdd8-23126287b3be', 'volume_size': 1, 'image_id': 'f6cc1815-69cc-4136-9021-9ac976bc7ece', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6cc1815-69cc-4136-9021-9ac976bc7ece', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95f9cbdb83475b395787c01426430b14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c86e7281734243fbac11d90ddaf803cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0831bd6825d231d225627ca7ae6761d01bb699050afecc2a0f9e2e1c028b3a3dba91c8fd497389b85f36d1b5966d2bb7492c6e29428f9d30544ad89783975c33', 'id': 'f6cc1815-69cc-4136-9021-9ac976bc7ece', 'created_at': datetime.datetime(2026, 7, 7, 23, 43, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 43, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6cc1815-69cc-4136-9021-9ac976bc7ece/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Trying to clone da9e4ad3-5636-413e-bdd8-23126287b3be from image f6cc1815-69cc-4136-9021-9ac976bc7ece at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6cc1815-69cc-4136-9021-9ac976bc7ece', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:43:58 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e07e5b-0111-489b-be41-37265cf84c65]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:58 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD Jul 08 01:43:58 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:59 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:59 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD Jul 08 01:43:59 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:00 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD" returned: 1 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:44:00 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Temporary image f6cc1815-69cc-4136-9021-9ac976bc7ece is fetched for user fe56e4ced24a4f01b699f88e0dd29170. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:44:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9e14a4-74e7-4acb-8e14-8f753155b5f3]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:00 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD Jul 08 01:44:00 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:01 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:01 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD Jul 08 01:44:01 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:02 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD" returned: 1 in 0.840s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9e4ad3-5636-413e-bdd8-23126287b3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86e7281734243fbac11d90ddaf803cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:58Z,use_quota=True,user_id='fe56e4ced24a4f01b699f88e0dd29170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49ed704d-b3a3-45de-b81b-187a456a3539),volume_type_id=49ed704d-b3a3-45de-b81b-187a456a3539)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Creating volume da9e4ad3-5636-413e-bdd8-23126287b3be {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:02 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:02 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be 1073741824 Jul 08 01:44:02 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:03 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be 1073741824" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:03 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be Jul 08 01:44:03 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:03 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be" returned: 0 in 0.733s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:03 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Attempting download of f6cc1815-69cc-4136-9021-9ac976bc7ece ((None, [{'url': 'file:///opt/stack/data/glance/images/f6cc1815-69cc-4136-9021-9ac976bc7ece', 'metadata': {}}])) to volume da9e4ad3-5636-413e-bdd8-23126287b3be. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:44:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c5c071-e52c-48fd-8951-9a6e10c7db80]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6cc1815-69cc-4136-9021-9ac976bc7ece_ex85ld92 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:04 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6cc1815-69cc-4136-9021-9ac976bc7ece_ex85ld92 Jul 08 01:44:04 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:04 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6cc1815-69cc-4136-9021-9ac976bc7ece_ex85ld92" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6cc1815-69cc-4136-9021-9ac976bc7ece_ex85ld92 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:04 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6cc1815-69cc-4136-9021-9ac976bc7ece_ex85ld92 Jul 08 01:44:04 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:05 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6cc1815-69cc-4136-9021-9ac976bc7ece_ex85ld92" returned: 1 in 0.778s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6cc1815-69cc-4136-9021-9ac976bc7ece_ex85ld92' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:44:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[423500e8-de0c-42f4-843e-bf8d30c1235a]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:05 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD Jul 08 01:44:05 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:06 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:06 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD Jul 08 01:44:06 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:07 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD" returned: 1 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:44:07 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] f6cc1815-69cc-4136-9021-9ac976bc7ece was raw, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:44:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:07 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be Jul 08 01:44:07 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:08 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be" returned: 0 in 0.852s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:08 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6cc1815-69cc-4136-9021-9ac976bc7ece__kra8plzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:44:08 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:44:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:08 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be 1G Jul 08 01:44:08 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:08 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be 1G" returned: 0 in 0.840s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d95f77-59ac-4744-8a7b-1616051ab3d7]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:09 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be Jul 08 01:44:09 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:09 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be" returned: 0 in 0.866s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:09 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be Jul 08 01:44:09 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:10 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be" returned: 1 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Downloaded image f6cc1815-69cc-4136-9021-9ac976bc7ece ((None, [{'url': 'file:///opt/stack/data/glance/images/f6cc1815-69cc-4136-9021-9ac976bc7ece', 'metadata': {}}])) to volume da9e4ad3-5636-413e-bdd8-23126287b3be successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Temporary image f6cc1815-69cc-4136-9021-9ac976bc7ece for user fe56e4ced24a4f01b699f88e0dd29170 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Marking volume da9e4ad3-5636-413e-bdd8-23126287b3be as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Copying metadata from image f6cc1815-69cc-4136-9021-9ac976bc7ece to da9e4ad3-5636-413e-bdd8-23126287b3be. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Creating volume glance metadata for volume da9e4ad3-5636-413e-bdd8-23126287b3be backed by image f6cc1815-69cc-4136-9021-9ac976bc7ece with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f6cc1815-69cc-4136-9021-9ac976bc7ece', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '95f9cbdb83475b395787c01426430b14', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75000fd2-e59e-47e0-b975-732246e595ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9e4ad3-5636-413e-bdd8-23126287b3be', 'volume_size': 1, 'image_id': 'f6cc1815-69cc-4136-9021-9ac976bc7ece', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6cc1815-69cc-4136-9021-9ac976bc7ece', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95f9cbdb83475b395787c01426430b14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c86e7281734243fbac11d90ddaf803cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0831bd6825d231d225627ca7ae6761d01bb699050afecc2a0f9e2e1c028b3a3dba91c8fd497389b85f36d1b5966d2bb7492c6e29428f9d30544ad89783975c33', 'id': 'f6cc1815-69cc-4136-9021-9ac976bc7ece', 'created_at': datetime.datetime(2026, 7, 7, 23, 43, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 43, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6cc1815-69cc-4136-9021-9ac976bc7ece/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0a841e-0ffe-46dd-af3a-93709dd804ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Volume volume-da9e4ad3-5636-413e-bdd8-23126287b3be (da9e4ad3-5636-413e-bdd8-23126287b3be): created successfully Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0a841e-0ffe-46dd-af3a-93709dd804ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Flow 'volume_create_manager' (40181e41-e10f-480a-af75-d4aca36e4d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cfaaf7db-4670-428a-9d52-ac3c887e2b6a tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Created volume successfully. Jul 08 01:44:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Acquiring lock "cinder-da9e4ad3-5636-413e-bdd8-23126287b3be-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "cinder-da9e4ad3-5636-413e-bdd8-23126287b3be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Acquiring lock "cinder-quobyte-da9e4ad3-5636-413e-bdd8-23126287b3be" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "cinder-quobyte-da9e4ad3-5636-413e-bdd8-23126287b3be" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e51d6a7-9e18-4694-ba96-4fddb1f04efd]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:11 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be Jul 08 01:44:11 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:12 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be" returned: 0 in 0.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:12 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be Jul 08 01:44:12 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:13 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be" returned: 1 in 0.850s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:13 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be Jul 08 01:44:13 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:13 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-da9e4ad3-5636-413e-bdd8-23126287b3be" returned: 0 in 0.749s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "cinder-quobyte-da9e4ad3-5636-413e-bdd8-23126287b3be" released by "delete_volume" :: held 2.526s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:13 devstack cinder-volume[87204]: WARNING cinder.quota [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:44:13 devstack cinder-volume[87204]: WARNING cinder.quota [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:44:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Created reservations ['5352efe2-1133-42e1-a03b-60d3cf12cfdd', '10518540-a565-4682-a63d-aa3dba016d4a', '78d9fad9-f51a-4816-bbca-a92e1749a066', '9a19feed-54b0-4afb-9d93-cf0b54cc7bca'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:14 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:44:14 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:14 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.767s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:14 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Deleted volume successfully. Jul 08 01:44:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8f1efff1-8004-4ada-8410-05a3117ed1a6 tempest-VolumeAndVolumeTypeFromImageTest-409520189 None] Lock "cinder-da9e4ad3-5636-413e-bdd8-23126287b3be-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (cbcb4d08-045a-4d23-aca4-0869af2e62e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160bc6d9-a29e-4173-bf4a-322e10744389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160bc6d9-a29e-4173-bf4a-322e10744389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-169599472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba25aec0-0ef0-4084-9f64-40b9978b929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:19Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37c652f-5068-4e53-9bd1-510388b511b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37c652f-5068-4e53-9bd1-510388b511b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b1fced-8778-49d8-a313-e25d6ccc2bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b1fced-8778-49d8-a313-e25d6ccc2bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba25aec0-0ef0-4084-9f64-40b9978b929a', 'volume_name': 'volume-ba25aec0-0ef0-4084-9f64-40b9978b929a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc00f18e-3ef7-47d8-81e8-3193c53d1e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc00f18e-3ef7-47d8-81e8-3193c53d1e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5c3230-90d3-4227-86f6-b7d0249bb5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Volume ba25aec0-0ef0-4084-9f64-40b9978b929a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba25aec0-0ef0-4084-9f64-40b9978b929a', 'volume_size': 1} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-169599472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba25aec0-0ef0-4084-9f64-40b9978b929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:19Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Creating volume ba25aec0-0ef0-4084-9f64-40b9978b929a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:19 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:19 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a 1073741824 Jul 08 01:44:19 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (29678c78-e8b5-4f50-b336-5134c394d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7c0b4f-ea60-4e8c-ae3b-21acbc237d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7c0b4f-ea60-4e8c-ae3b-21acbc237d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-342805050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf35089-6b16-40c8-8bbf-4c4f34e316cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:20Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bb1340-333a-4d9a-ba39-1433ac6e4038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bb1340-333a-4d9a-ba39-1433ac6e4038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6435daea-125f-4470-8800-8b1f0bb259f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6435daea-125f-4470-8800-8b1f0bb259f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf35089-6b16-40c8-8bbf-4c4f34e316cc', 'volume_name': 'volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9498c372-3a44-4f96-bdcc-8ae00f778582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9498c372-3a44-4f96-bdcc-8ae00f778582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688189bf-c866-4177-804b-3cab05015b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Volume 7cf35089-6b16-40c8-8bbf-4c4f34e316cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc', 'volume_size': 1} Jul 08 01:44:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (506fddf3-8999-45c4-a97c-7eb4dd4c1bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a22cb3c-91be-4a91-9478-e5b203d366b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a22cb3c-91be-4a91-9478-e5b203d366b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1849744637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:20Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b7a82c-dc94-42cf-b648-b29c38237d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b7a82c-dc94-42cf-b648-b29c38237d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f43719-87d2-4e2d-aa5f-9630aa5c82fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f43719-87d2-4e2d-aa5f-9630aa5c82fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7', 'volume_name': 'volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6104ab2d-7308-4722-bde8-0a2e62a2d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6104ab2d-7308-4722-bde8-0a2e62a2d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9c180e-7c2f-47a6-b6f9-6805dd9a57aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Volume cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7', 'volume_size': 1} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (edad2462-82b8-42d2-be41-025024aeb8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:20 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab99788-7039-4cb2-8cf6-90ed1df755a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a 1073741824" returned: 0 in 1.119s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab99788-7039-4cb2-8cf6-90ed1df755a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-47632066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2c5e88-97ee-4c51-9e67-b30c0a5337ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:20Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c9e78b-e12c-4162-8ace-dc0b592cb32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c9e78b-e12c-4162-8ace-dc0b592cb32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10be1ab0-9aab-40c7-b987-1937df76099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10be1ab0-9aab-40c7-b987-1937df76099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2c5e88-97ee-4c51-9e67-b30c0a5337ee', 'volume_name': 'volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a929fae-4348-40db-b7cf-7267dbd21ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a929fae-4348-40db-b7cf-7267dbd21ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b29ff6-d101-4956-bd43-5825d9a5d943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Volume ad2c5e88-97ee-4c51-9e67-b30c0a5337ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee', 'volume_size': 1} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:20 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a Jul 08 01:44:20 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (b56fa79f-9b09-483d-915f-b273d1690bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba63c8f-4001-4160-ba60-3db221e72d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba63c8f-4001-4160-ba60-3db221e72d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936318814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56cbc20-6273-42e4-8322-560c516ff8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:21Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c4aa39-03b1-4e8e-b491-d54c4f87a484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c4aa39-03b1-4e8e-b491-d54c4f87a484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23df3b75-6a73-4253-b2eb-068446a71c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23df3b75-6a73-4253-b2eb-068446a71c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c56cbc20-6273-42e4-8322-560c516ff8e0', 'volume_name': 'volume-c56cbc20-6273-42e4-8322-560c516ff8e0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e3938b-d755-40e6-85cc-e24a443ce64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e3938b-d755-40e6-85cc-e24a443ce64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bb6a78-2d8f-4a32-a1d9-d46604722982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Volume c56cbc20-6273-42e4-8322-560c516ff8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c56cbc20-6273-42e4-8322-560c516ff8e0', 'volume_size': 1} Jul 08 01:44:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:21 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a" returned: 0 in 0.713s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-342805050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf35089-6b16-40c8-8bbf-4c4f34e316cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:20Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Creating volume 7cf35089-6b16-40c8-8bbf-4c4f34e316cc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:21 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5c3230-90d3-4227-86f6-b7d0249bb5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba25aec0-0ef0-4084-9f64-40b9978b929a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a094160-71a9-4511-9ec7-212bcaf13c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:21 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc 1073741824 Jul 08 01:44:21 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Volume volume-ba25aec0-0ef0-4084-9f64-40b9978b929a (ba25aec0-0ef0-4084-9f64-40b9978b929a): created successfully Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a094160-71a9-4511-9ec7-212bcaf13c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (cbcb4d08-045a-4d23-aca4-0869af2e62e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5b6695dd-c047-438a-a9d7-0d699d460d76 tempest-CreateVolumesFromImageTest-866791626 None] Created volume successfully. Jul 08 01:44:22 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc 1073741824" returned: 0 in 0.895s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:22 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc Jul 08 01:44:22 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:22 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc" returned: 0 in 0.685s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.804s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1849744637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:20Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Creating volume cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:22 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688189bf-c866-4177-804b-3cab05015b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:22 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 1073741824 Jul 08 01:44:22 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8dd9e8-db5a-4411-b576-45ec13d1759c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Volume volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc (7cf35089-6b16-40c8-8bbf-4c4f34e316cc): created successfully Jul 08 01:44:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8dd9e8-db5a-4411-b576-45ec13d1759c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (29678c78-e8b5-4f50-b336-5134c394d227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4f43dcfe-4771-435b-af5a-1f9cb533348f tempest-CreateVolumesFromImageTest-866791626 None] Created volume successfully. Jul 08 01:44:23 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 1073741824" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:23 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 Jul 08 01:44:23 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:24 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.043s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-47632066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2c5e88-97ee-4c51-9e67-b30c0a5337ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:20Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Creating volume ad2c5e88-97ee-4c51-9e67-b30c0a5337ee {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:24 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:24 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee 1073741824 Jul 08 01:44:24 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9c180e-7c2f-47a6-b6f9-6805dd9a57aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1fdf00-566c-4fdb-a183-e2a6915956c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Volume volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 (cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7): created successfully Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1fdf00-566c-4fdb-a183-e2a6915956c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (506fddf3-8999-45c4-a97c-7eb4dd4c1bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-19348f59-9609-4f75-82bf-cbeb0fd3bedc tempest-CreateVolumesFromImageTest-866791626 None] Created volume successfully. Jul 08 01:44:25 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee 1073741824" returned: 0 in 0.849s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:25 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee Jul 08 01:44:25 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:26 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee" returned: 0 in 0.712s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.227s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936318814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56cbc20-6273-42e4-8322-560c516ff8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08aca7912c423cb552e721ae3e5f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:21Z,use_quota=True,user_id='4b5c8538e2c44f96879d2c8822e66c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Creating volume c56cbc20-6273-42e4-8322-560c516ff8e0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:26 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:26 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0 1073741824 Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b29ff6-d101-4956-bd43-5825d9a5d943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:26 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48766cf-4a8d-44fe-bf89-99d40a01161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Volume volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee (ad2c5e88-97ee-4c51-9e67-b30c0a5337ee): created successfully Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48766cf-4a8d-44fe-bf89-99d40a01161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (edad2462-82b8-42d2-be41-025024aeb8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8f4535ff-5620-4b6a-9a67-e28fc9365943 tempest-CreateVolumesFromImageTest-866791626 None] Created volume successfully. Jul 08 01:44:27 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0 1073741824" returned: 0 in 0.832s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:27 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0 Jul 08 01:44:27 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:27 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0" returned: 0 in 0.751s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bb6a78-2d8f-4a32-a1d9-d46604722982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c56cbc20-6273-42e4-8322-560c516ff8e0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1328426-6789-4464-b25c-bc9ba9080e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:27 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Volume volume-c56cbc20-6273-42e4-8322-560c516ff8e0 (c56cbc20-6273-42e4-8322-560c516ff8e0): created successfully Jul 08 01:44:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1328426-6789-4464-b25c-bc9ba9080e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Flow 'volume_create_manager' (b56fa79f-9b09-483d-915f-b273d1690bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7f4c2c64-37cb-4a12-95a3-d2b0b8fc5d9e tempest-CreateVolumesFromImageTest-866791626 None] Created volume successfully. Jul 08 01:44:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-c56cbc20-6273-42e4-8322-560c516ff8e0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-c56cbc20-6273-42e4-8322-560c516ff8e0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-quobyte-c56cbc20-6273-42e4-8322-560c516ff8e0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-c56cbc20-6273-42e4-8322-560c516ff8e0" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e480d6e-1e4c-4ac2-aaf5-0e385a634950]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:28 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0 Jul 08 01:44:28 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:29 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0" returned: 0 in 0.808s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:29 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0 Jul 08 01:44:29 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:30 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c56cbc20-6273-42e4-8322-560c516ff8e0" returned: 0 in 0.656s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-c56cbc20-6273-42e4-8322-560c516ff8e0" released by "delete_volume" :: held 1.512s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Created reservations ['9948ae63-755d-434c-a5f4-419fe1a92954', 'a9743ab1-b1d7-4c3f-9167-a1d6c3409edc', '42a351a0-902c-44fe-b4c1-a4198de1b5fa', '63a51157-be2b-472d-bf12-d5cdd02d187c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:30 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:44:30 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-quobyte-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5241015d-4963-4610-9595-1ac6219aaf21]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:31 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:31 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Deleted volume successfully. Jul 08 01:44:31 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee Jul 08 01:44:31 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c655969a-1e5d-444c-a91c-327660f58c75 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-c56cbc20-6273-42e4-8322-560c516ff8e0-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:31 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee" returned: 0 in 0.866s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:31 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee Jul 08 01:44:31 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:32 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee" released by "delete_volume" :: held 1.657s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:32 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Created reservations ['6b5903c7-15ac-4653-adcd-de3f1a8ad41a', '1a314785-c256-4944-a7eb-c02df4df9ce5', '025962f2-dc85-44d0-b0e3-3d23e0a90bd8', '1c0d84f4-c062-454b-89ea-32cc20bf1da3'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:32 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:44:32 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-quobyte-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce36783-675a-4f91-9d8f-f791ba3c34c6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:33 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 Jul 08 01:44:33 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:33 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.769s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:33 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Deleted volume successfully. Jul 08 01:44:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-740b14b0-ec8b-434d-bace-ac45d81003ac tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-ad2c5e88-97ee-4c51-9e67-b30c0a5337ee-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:34 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7" returned: 0 in 0.875s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:34 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7 Jul 08 01:44:34 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:34 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7" released by "delete_volume" :: held 1.670s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:34 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Created reservations ['fc4dc856-6c45-4471-b366-62d4164c78c1', 'af0d009c-e213-455f-b281-c9e81cf7466a', '2cdf02bd-fe82-4a5c-967b-74a8f3f05109', '172d7136-f535-49c8-9ff3-32cd20bf189a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:35 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:44:35 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-7cf35089-6b16-40c8-8bbf-4c4f34e316cc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-7cf35089-6b16-40c8-8bbf-4c4f34e316cc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-quobyte-7cf35089-6b16-40c8-8bbf-4c4f34e316cc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-7cf35089-6b16-40c8-8bbf-4c4f34e316cc" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[242e1014-69aa-4f3b-a762-2f21553c3b38]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:35 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc Jul 08 01:44:35 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:35 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Deleted volume successfully. Jul 08 01:44:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0f803099-69f7-4abc-9497-b7240fa930a5 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-cdfc90d5-bbfb-4de4-8907-4be9a8cd74d7-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:36 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc" returned: 0 in 0.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:36 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc Jul 08 01:44:36 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:37 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-7cf35089-6b16-40c8-8bbf-4c4f34e316cc" returned: 0 in 0.698s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-7cf35089-6b16-40c8-8bbf-4c4f34e316cc" released by "delete_volume" :: held 1.610s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Created reservations ['52e2bd8f-53a4-4ecc-8d66-444962f8d3c5', '5a55179d-0c76-4134-b52a-986b8963e483', 'c44be28c-96ac-4962-ad5d-cf036006034a', '2f4f5582-56f0-46dc-8dba-2d91792c3cd6'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:37 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:44:37 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-ba25aec0-0ef0-4084-9f64-40b9978b929a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-ba25aec0-0ef0-4084-9f64-40b9978b929a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "cinder-quobyte-ba25aec0-0ef0-4084-9f64-40b9978b929a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-ba25aec0-0ef0-4084-9f64-40b9978b929a" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfda0ea-c9c8-4042-b107-823e8449ec7e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:37 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a Jul 08 01:44:37 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:38 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.766s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:38 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Deleted volume successfully. Jul 08 01:44:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-14b494e1-8259-485f-b962-d5d301cb8366 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-7cf35089-6b16-40c8-8bbf-4c4f34e316cc-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:38 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a" returned: 0 in 0.882s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:38 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a Jul 08 01:44:38 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:39 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-ba25aec0-0ef0-4084-9f64-40b9978b929a" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-quobyte-ba25aec0-0ef0-4084-9f64-40b9978b929a" released by "delete_volume" :: held 1.717s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:39 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Created reservations ['1cd5bd05-ce0a-42dd-92c9-fbcc7b2f6baf', '2995cf80-ae9c-4bbf-bc71-c6efc56dcc31', '4d179587-b445-4943-957b-ea573962c17c', '23be71c7-c53a-4b6c-ae6b-31de9b153458'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:39 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:44:39 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:40 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.722s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:40 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Deleted volume successfully. Jul 08 01:44:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d2313a5f-3725-481f-bd5c-8ac3f09684f3 tempest-CreateVolumesFromImageTest-866791626 None] Lock "cinder-ba25aec0-0ef0-4084-9f64-40b9978b929a-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (dde52cc5-80ed-4b14-876a-7d136b75a2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ceb53c0-8086-44cc-8779-ada8fda16fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ceb53c0-8086-44cc-8779-ada8fda16fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2125829111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcb507c-4ab5-4d81-b3f2-abe8512fb762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:43Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db048d08-f7c5-4dcd-9662-27eca47e0577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db048d08-f7c5-4dcd-9662-27eca47e0577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eabae47-c977-458c-8037-6457647d45f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eabae47-c977-458c-8037-6457647d45f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcb507c-4ab5-4d81-b3f2-abe8512fb762', 'volume_name': 'volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b75016-6291-4ad9-9c59-2b0b623c3b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b75016-6291-4ad9-9c59-2b0b623c3b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523c662b-d763-4f79-aeca-e0d99e7c5d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:42 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume 9bcb507c-4ab5-4d81-b3f2-abe8512fb762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762', 'volume_size': 1} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2125829111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcb507c-4ab5-4d81-b3f2-abe8512fb762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:43Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Creating volume 9bcb507c-4ab5-4d81-b3f2-abe8512fb762 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:42 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:42 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 1073741824 Jul 08 01:44:42 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:43 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 1073741824" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:43 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 Jul 08 01:44:43 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:44 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762" returned: 0 in 0.716s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523c662b-d763-4f79-aeca-e0d99e7c5d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904fcde0-4748-4948-ba29-c376041333a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 (9bcb507c-4ab5-4d81-b3f2-abe8512fb762): created successfully Jul 08 01:44:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904fcde0-4748-4948-ba29-c376041333a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (dde52cc5-80ed-4b14-876a-7d136b75a2ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-31d3062e-7cd3-4405-8e38-1bb064e58864 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created volume successfully. Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (80b98edb-807d-4966-ad32-aef74631e5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f845acb-65c6-4f40-912a-2341b3d25697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f845acb-65c6-4f40-912a-2341b3d25697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-356354664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b952f12-17dc-474d-b57d-43c0134475ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:45Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c074a6a-1384-4dc2-b34c-c2938ac8e07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c074a6a-1384-4dc2-b34c-c2938ac8e07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2295016f-8ea2-471c-a519-6aabc039d7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2295016f-8ea2-471c-a519-6aabc039d7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b952f12-17dc-474d-b57d-43c0134475ab', 'volume_name': 'volume-5b952f12-17dc-474d-b57d-43c0134475ab', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5198f3de-f249-4b52-b76a-dd0446bd3950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5198f3de-f249-4b52-b76a-dd0446bd3950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56349e19-6195-4d69-b415-051a7fd9b30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume 5b952f12-17dc-474d-b57d-43c0134475ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b952f12-17dc-474d-b57d-43c0134475ab', 'volume_size': 1} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-356354664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b952f12-17dc-474d-b57d-43c0134475ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:45Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Creating volume 5b952f12-17dc-474d-b57d-43c0134475ab {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:45 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:45 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab 1073741824 Jul 08 01:44:45 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (4e8a3784-d3ac-4316-8fad-87a32d52788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b53b7dc-bdea-4b36-bb63-70064e18e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b53b7dc-bdea-4b36-bb63-70064e18e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609491714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d3490b-17f5-45c8-973f-fb97b863918c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:46Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f36eeb-5c01-4e44-a92f-3d9f8ccb25db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f36eeb-5c01-4e44-a92f-3d9f8ccb25db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136e86e0-ff83-4e66-b225-dafe591aa014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136e86e0-ff83-4e66-b225-dafe591aa014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d3490b-17f5-45c8-973f-fb97b863918c', 'volume_name': 'volume-79d3490b-17f5-45c8-973f-fb97b863918c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974b7f50-a79b-4b10-9bb5-d6899bd4f7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974b7f50-a79b-4b10-9bb5-d6899bd4f7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b39352-08ee-4ef4-8c06-3190169e97cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:45 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume 79d3490b-17f5-45c8-973f-fb97b863918c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d3490b-17f5-45c8-973f-fb97b863918c', 'volume_size': 1} Jul 08 01:44:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (b6f7f947-b751-4460-b6d5-9c8f49949fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac764efc-5615-49fa-b55e-a3a88a36439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac764efc-5615-49fa-b55e-a3a88a36439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1228346378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32aea889-00ef-4cb3-b706-6f5f6f039ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:46Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bae904d-8cc9-4f9c-8ba0-1a4e63f166c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bae904d-8cc9-4f9c-8ba0-1a4e63f166c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45aef2d-bee5-414c-b0d3-b18d0d1719ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45aef2d-bee5-414c-b0d3-b18d0d1719ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32aea889-00ef-4cb3-b706-6f5f6f039ca6', 'volume_name': 'volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de20ea4-7f58-4c3a-abcf-94619b1cd2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de20ea4-7f58-4c3a-abcf-94619b1cd2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7b4030-4bbc-4337-b372-66316bb13210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume 32aea889-00ef-4cb3-b706-6f5f6f039ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6', 'volume_size': 1} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:46 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab 1073741824" returned: 0 in 0.952s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:46 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab Jul 08 01:44:46 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (5340c5ae-0c89-4aed-96c1-375888899a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697ab380-cfac-4487-9919-9c6f878572c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697ab380-cfac-4487-9919-9c6f878572c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158811483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dda6d08-ae78-459c-940c-e14ac04956dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:47Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc46957-de95-44f2-a524-baedb5b4af01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc46957-de95-44f2-a524-baedb5b4af01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f25fb0-66a4-45c1-92a1-e41d1f4628e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f25fb0-66a4-45c1-92a1-e41d1f4628e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dda6d08-ae78-459c-940c-e14ac04956dc', 'volume_name': 'volume-6dda6d08-ae78-459c-940c-e14ac04956dc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0361a972-edf5-4eb5-91e2-c8e3676f23aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0361a972-edf5-4eb5-91e2-c8e3676f23aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca42f6a-0510-406a-a48d-86758cdbaf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume 6dda6d08-ae78-459c-940c-e14ac04956dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dda6d08-ae78-459c-940c-e14ac04956dc', 'volume_size': 1} Jul 08 01:44:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (f557aaca-62de-4b38-a66c-3e19b94f2378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5509e3b3-b94b-4d47-ab77-dcee51851fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5509e3b3-b94b-4d47-ab77-dcee51851fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137177043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ad7548-3fe5-41a2-b061-e8cd33a658eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:47Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abba315b-bd10-4238-a529-7f7dc92a8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abba315b-bd10-4238-a529-7f7dc92a8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12dfc305-133a-4d4e-bc16-88d06df09d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12dfc305-133a-4d4e-bc16-88d06df09d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ad7548-3fe5-41a2-b061-e8cd33a658eb', 'volume_name': 'volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea44eeb5-51ea-4c6b-8a78-7b6ad1badade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea44eeb5-51ea-4c6b-8a78-7b6ad1badade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d03f480-cb3e-4e73-959c-1d166bc93ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:47 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume 03ad7548-3fe5-41a2-b061-e8cd33a658eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb', 'volume_size': 1} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:47 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609491714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d3490b-17f5-45c8-973f-fb97b863918c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:46Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Creating volume 79d3490b-17f5-45c8-973f-fb97b863918c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:47 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56349e19-6195-4d69-b415-051a7fd9b30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b952f12-17dc-474d-b57d-43c0134475ab', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:47 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c 1073741824 Jul 08 01:44:47 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0de8f87-02d2-46b7-aa98-10aa85033f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:47 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume volume-5b952f12-17dc-474d-b57d-43c0134475ab (5b952f12-17dc-474d-b57d-43c0134475ab): created successfully Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0de8f87-02d2-46b7-aa98-10aa85033f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (80b98edb-807d-4966-ad32-aef74631e5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-294c04d5-4f69-4003-9595-012f588b0c8e tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created volume successfully. Jul 08 01:44:48 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c 1073741824" returned: 0 in 0.890s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:48 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c Jul 08 01:44:48 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:48 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c" returned: 0 in 0.714s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.553s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1228346378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32aea889-00ef-4cb3-b706-6f5f6f039ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:46Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Creating volume 32aea889-00ef-4cb3-b706-6f5f6f039ca6 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:48 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:49 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 1073741824 Jul 08 01:44:49 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b39352-08ee-4ef4-8c06-3190169e97cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d3490b-17f5-45c8-973f-fb97b863918c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a71bbf1-48c7-4e18-a92c-99426d098dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume volume-79d3490b-17f5-45c8-973f-fb97b863918c (79d3490b-17f5-45c8-973f-fb97b863918c): created successfully Jul 08 01:44:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a71bbf1-48c7-4e18-a92c-99426d098dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (4e8a3784-d3ac-4316-8fad-87a32d52788d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eee10644-1b2c-4003-9d14-732a7a4049c6 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created volume successfully. Jul 08 01:44:49 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 1073741824" returned: 0 in 0.926s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:49 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 Jul 08 01:44:49 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:50 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6" returned: 0 in 0.679s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.748s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158811483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dda6d08-ae78-459c-940c-e14ac04956dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:47Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Creating volume 6dda6d08-ae78-459c-940c-e14ac04956dc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:50 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc 1073741824 Jul 08 01:44:50 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7b4030-4bbc-4337-b372-66316bb13210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b305e33c-a516-4320-9f87-34ac17c1b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 (32aea889-00ef-4cb3-b706-6f5f6f039ca6): created successfully Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b305e33c-a516-4320-9f87-34ac17c1b640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (b6f7f947-b751-4460-b6d5-9c8f49949fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-86a4ab9f-093a-4156-9ad6-245da23ddc9a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created volume successfully. Jul 08 01:44:51 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc 1073741824" returned: 0 in 0.876s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:51 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc Jul 08 01:44:51 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:52 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc" returned: 0 in 0.697s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137177043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ad7548-3fe5-41a2-b061-e8cd33a658eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57270d039baf4aa693bb2f779819f446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:47Z,use_quota=True,user_id='92646fd1dcc845888e204abcbad9ad8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Creating volume 03ad7548-3fe5-41a2-b061-e8cd33a658eb {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:52 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=76,cinder:SELECT=55,cinder:INSERT=23,cinder:DELETE=9 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca42f6a-0510-406a-a48d-86758cdbaf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dda6d08-ae78-459c-940c-e14ac04956dc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:52 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb 1073741824 Jul 08 01:44:52 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d14e1ad-fceb-48f4-b7f0-0aef683c4921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume volume-6dda6d08-ae78-459c-940c-e14ac04956dc (6dda6d08-ae78-459c-940c-e14ac04956dc): created successfully Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d14e1ad-fceb-48f4-b7f0-0aef683c4921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (5340c5ae-0c89-4aed-96c1-375888899a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a060f5c-9111-4b90-af91-b815772dc64a tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created volume successfully. Jul 08 01:44:53 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb 1073741824" returned: 0 in 0.967s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=64,cinder:UPDATE=90,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:53 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb Jul 08 01:44:53 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:53 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:44:53 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:54 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb" returned: 0 in 0.798s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d03f480-cb3e-4e73-959c-1d166bc93ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97535a40-f22f-49e2-9368-51d80f8cf761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Volume volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb (03ad7548-3fe5-41a2-b061-e8cd33a658eb): created successfully Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97535a40-f22f-49e2-9368-51d80f8cf761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Flow 'volume_create_manager' (f557aaca-62de-4b38-a66c-3e19b94f2378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-63da2110-d8bf-498e-b871-007c2218fd0f tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created volume successfully. Jul 08 01:44:54 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.798s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:44:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:44:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-03ad7548-3fe5-41a2-b061-e8cd33a658eb-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-03ad7548-3fe5-41a2-b061-e8cd33a658eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-quobyte-03ad7548-3fe5-41a2-b061-e8cd33a658eb" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-03ad7548-3fe5-41a2-b061-e8cd33a658eb" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[342243a0-cc87-4658-9230-e304ff9e2ddf]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:55 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb Jul 08 01:44:55 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:56 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb" returned: 0 in 0.873s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:56 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb Jul 08 01:44:56 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:56 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-03ad7548-3fe5-41a2-b061-e8cd33a658eb" returned: 0 in 0.779s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-03ad7548-3fe5-41a2-b061-e8cd33a658eb" released by "delete_volume" :: held 1.694s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created reservations ['1d707ef1-d01f-41c7-8483-c08827062c71', 'b8231d1b-80a5-439e-9e5e-21418ede90c6', 'c8edac65-e20a-4ae5-978b-ad14e344cc50', '6bfeb665-7043-4226-a16b-2a744881aaf4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:56 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:44:56 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-6dda6d08-ae78-459c-940c-e14ac04956dc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-6dda6d08-ae78-459c-940c-e14ac04956dc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-quobyte-6dda6d08-ae78-459c-940c-e14ac04956dc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-6dda6d08-ae78-459c-940c-e14ac04956dc" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a547a8-cd51-48d0-871d-5d3a790fe9fa]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:57 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc Jul 08 01:44:57 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:57 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.790s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:57 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Deleted volume successfully. Jul 08 01:44:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1b22a671-3212-45c4-ba15-53273e5780c8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-03ad7548-3fe5-41a2-b061-e8cd33a658eb-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:58 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc" returned: 0 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:58 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc Jul 08 01:44:58 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:58 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-6dda6d08-ae78-459c-940c-e14ac04956dc" returned: 0 in 0.701s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-6dda6d08-ae78-459c-940c-e14ac04956dc" released by "delete_volume" :: held 1.562s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created reservations ['0c261f87-c9a5-4774-bc9e-a1104a24b4d7', '2e0c8267-dd9e-4939-9a09-c47a36af3436', '84e604b3-dcdf-4bd2-bdfb-8f2bd6ae87cc', '1064c0f7-ca07-4fac-8c3b-8d8fda25a7d5'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:59 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:44:59 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-32aea889-00ef-4cb3-b706-6f5f6f039ca6-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-32aea889-00ef-4cb3-b706-6f5f6f039ca6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-quobyte-32aea889-00ef-4cb3-b706-6f5f6f039ca6" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-32aea889-00ef-4cb3-b706-6f5f6f039ca6" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa32374-0f76-4e0e-be27-9cbdb12570b0]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:59 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 Jul 08 01:44:59 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:59 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.830s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Deleted volume successfully. Jul 08 01:44:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-65b553a1-a92d-4fa2-b383-2550eb05c61d tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-6dda6d08-ae78-459c-940c-e14ac04956dc-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:00 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6" returned: 0 in 0.972s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:00 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6 Jul 08 01:45:00 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:01 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-32aea889-00ef-4cb3-b706-6f5f6f039ca6" returned: 0 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-32aea889-00ef-4cb3-b706-6f5f6f039ca6" released by "delete_volume" :: held 1.805s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created reservations ['deb8c527-d655-4bdf-8959-e5d4ae6d6400', '4067cea0-7c0e-4146-b98c-b0cadcbeacdb', 'ad0717b1-8d4e-455b-adfa-8f960f664c6c', '753aa775-c27e-4f8c-a8e4-d9f626f0a159'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:01 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:01 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-79d3490b-17f5-45c8-973f-fb97b863918c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-79d3490b-17f5-45c8-973f-fb97b863918c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-quobyte-79d3490b-17f5-45c8-973f-fb97b863918c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-79d3490b-17f5-45c8-973f-fb97b863918c" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa85a53c-c326-4fa3-8d1a-954432ad4cff]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:02 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c Jul 08 01:45:02 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:02 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.805s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:02 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Deleted volume successfully. Jul 08 01:45:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1d0385e6-8f82-45c9-a31a-3b41c6962390 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-32aea889-00ef-4cb3-b706-6f5f6f039ca6-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:02 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c" returned: 0 in 0.847s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:02 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c Jul 08 01:45:02 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:03 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-79d3490b-17f5-45c8-973f-fb97b863918c" returned: 0 in 0.798s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-79d3490b-17f5-45c8-973f-fb97b863918c" released by "delete_volume" :: held 1.697s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:03 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created reservations ['6a872fa5-12db-446c-8d0f-93d1078d1488', 'a184c0b1-8a80-4050-8713-dc41371f4fe5', '3a495552-15dd-49a7-b3e5-6a183d138af0', 'e67f7b28-47a0-488c-ac56-68eadad4954d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:03 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:03 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-5b952f12-17dc-474d-b57d-43c0134475ab-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-5b952f12-17dc-474d-b57d-43c0134475ab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-quobyte-5b952f12-17dc-474d-b57d-43c0134475ab" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-5b952f12-17dc-474d-b57d-43c0134475ab" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:04 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2e1626-535b-4ea1-a1bd-ab7dabfa79c4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:04 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab Jul 08 01:45:04 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:04 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.767s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:04 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Deleted volume successfully. Jul 08 01:45:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5f5f3b74-57fc-49ba-b309-eacc8dc43eee tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-79d3490b-17f5-45c8-973f-fb97b863918c-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:05 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab" returned: 0 in 0.854s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:05 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab Jul 08 01:45:05 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:05 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5b952f12-17dc-474d-b57d-43c0134475ab" returned: 0 in 0.696s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-5b952f12-17dc-474d-b57d-43c0134475ab" released by "delete_volume" :: held 1.591s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created reservations ['b2a91005-4604-4855-b3d1-40a34d56abdb', '69ee95d8-cc15-4401-bad7-e44f034d6eda', '86c4b178-9641-4940-8e66-1338d4d401c0', 'c0a0f203-903a-4cd0-ad22-fef1389003b7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:06 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:06 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-9bcb507c-4ab5-4d81-b3f2-abe8512fb762-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-9bcb507c-4ab5-4d81-b3f2-abe8512fb762-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "cinder-quobyte-9bcb507c-4ab5-4d81-b3f2-abe8512fb762" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-9bcb507c-4ab5-4d81-b3f2-abe8512fb762" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f992b38e-cbc8-4b81-b7b3-7edd2fca21e8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:06 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 Jul 08 01:45:06 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:06 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.767s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Deleted volume successfully. Jul 08 01:45:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-07651c94-275f-48d4-b762-9efdc39727f4 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-5b952f12-17dc-474d-b57d-43c0134475ab-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:07 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:07 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762 Jul 08 01:45:07 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:08 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9bcb507c-4ab5-4d81-b3f2-abe8512fb762" returned: 0 in 0.732s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-quobyte-9bcb507c-4ab5-4d81-b3f2-abe8512fb762" released by "delete_volume" :: held 1.655s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Created reservations ['b711ee6b-225c-44c8-8624-cf0f617bb1a2', 'cbd980d4-e7c8-49cf-b2c9-29239673f1a6', 'cafdf909-4693-40ef-8c23-f24b99a16077', '245c629d-8baa-45e9-9c32-d65a61c7176d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:08 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:08 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:09 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Deleted volume successfully. Jul 08 01:45:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-06d2ce99-e579-4c20-a783-33f3439012b8 tempest-CreateVolumesFromSourceVolumeTest-1847361740 None] Lock "cinder-9bcb507c-4ab5-4d81-b3f2-abe8512fb762-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Flow 'volume_create_manager' (649ceae3-a63d-4b8b-8491-d94272fbed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0b4be7-4aae-4c14-95f5-e93403f94d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0b4be7-4aae-4c14-95f5-e93403f94d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1383268374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a904924f166b497c866de0e4e5056484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:21Z,use_quota=True,user_id='f83b856510624aea85c479fbee843128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dc5929-656d-4f37-ad57-e93633d221b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dc5929-656d-4f37-ad57-e93633d221b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107b268b-3aeb-440a-810c-d815900be84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107b268b-3aeb-440a-810c-d815900be84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d', 'volume_name': 'volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82811042-4471-44d5-8f5a-f96c75754087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82811042-4471-44d5-8f5a-f96c75754087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bfb739-d177-4ef2-8390-decd995acbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Volume 610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d', 'volume_size': 1} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1383268374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a904924f166b497c866de0e4e5056484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:21Z,use_quota=True,user_id='f83b856510624aea85c479fbee843128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Creating volume 610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:21 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:21 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d 1073741824 Jul 08 01:45:21 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (2b8eb974-59dd-4810-95d4-faec7de10e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a21948-795d-4dcd-adc3-5ff41c7bf2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a21948-795d-4dcd-adc3-5ff41c7bf2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542914677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb121d0-c2c0-4f34-a522-2289f34e05aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:22Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79daa79-4ce8-4a36-b417-182828c0a535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79daa79-4ce8-4a36-b417-182828c0a535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1144e3-bfad-41a9-a4a1-20111042fd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1144e3-bfad-41a9-a4a1-20111042fd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb121d0-c2c0-4f34-a522-2289f34e05aa', 'volume_name': 'volume-edb121d0-c2c0-4f34-a522-2289f34e05aa', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4cdd58-323a-4a43-8ee1-b28d2da7fbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4cdd58-323a-4a43-8ee1-b28d2da7fbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef7b8ec-2460-435f-a5de-27682e235611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume edb121d0-c2c0-4f34-a522-2289f34e05aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb121d0-c2c0-4f34-a522-2289f34e05aa', 'volume_size': 1} Jul 08 01:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:22 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d 1073741824" returned: 0 in 1.129s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:22 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d Jul 08 01:45:22 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:23 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" returned: 0 in 0.893s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.905s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542914677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb121d0-c2c0-4f34-a522-2289f34e05aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:22Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Creating volume edb121d0-c2c0-4f34-a522-2289f34e05aa {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:23 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bfb739-d177-4ef2-8390-decd995acbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee576f8-cf8b-468c-b2b0-f3177b1aaeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:23 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa 1073741824 Jul 08 01:45:23 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Volume volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d (610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d): created successfully Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee576f8-cf8b-468c-b2b0-f3177b1aaeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Flow 'volume_create_manager' (649ceae3-a63d-4b8b-8491-d94272fbed77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-63536693-4735-456a-a07f-2f84fd2787ae tempest-VolumeDependencyTests-1942376705 None] Created volume successfully. Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Flow 'volume_create_manager' (c51041ee-eeb8-4ab7-a4f7-836e3947e973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83c6a90-b996-4b23-861b-67d1e026879e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83c6a90-b996-4b23-861b-67d1e026879e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdbf471-b94f-4d23-92af-31f4985e1f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5eb1b06350848e19690d2403f8926a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:24Z,use_quota=True,user_id='c37fb00b2dfb491b8fa92076246da022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afba630-a15e-49cf-88f1-c97cc918992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afba630-a15e-49cf-88f1-c97cc918992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5e639c-1b93-45d6-a023-adf00fec772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5e639c-1b93-45d6-a023-adf00fec772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cbdbf471-b94f-4d23-92af-31f4985e1f95', 'volume_name': 'volume-cbdbf471-b94f-4d23-92af-31f4985e1f95', 'volume_size': 1, 'image_id': 'de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38b6dca7c315775e81200e21217e9eec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5eb1b06350848e19690d2403f8926a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11b414035c6ffd0b011be1279563d74648f98aca014583cc4cd5bf7525e8797b3175c22107a597c1cf015f95242332ec898117eb5251103b386f2b74c11e5ac4', 'id': 'de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'created_at': datetime.datetime(2026, 7, 7, 23, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de9497d9-eaf4-480f-bd06-ff476adfbe2a/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0261ebdb-bf1a-4ea8-ba59-a622db263170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0261ebdb-bf1a-4ea8-ba59-a622db263170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c2948d-a1f0-498d-8710-efe90226d565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Volume cbdbf471-b94f-4d23-92af-31f4985e1f95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cbdbf471-b94f-4d23-92af-31f4985e1f95', 'volume_size': 1, 'image_id': 'de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38b6dca7c315775e81200e21217e9eec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5eb1b06350848e19690d2403f8926a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11b414035c6ffd0b011be1279563d74648f98aca014583cc4cd5bf7525e8797b3175c22107a597c1cf015f95242332ec898117eb5251103b386f2b74c11e5ac4', 'id': 'de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'created_at': datetime.datetime(2026, 7, 7, 23, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de9497d9-eaf4-480f-bd06-ff476adfbe2a/file', 'properties': {}}, 'image_service': } Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Trying to clone cbdbf471-b94f-4d23-92af-31f4985e1f95 from image de9497d9-eaf4-480f-bd06-ff476adfbe2a at location (None, [{'url': 'file:///opt/stack/data/glance/images/de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:45:24 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa 1073741824" returned: 0 in 1.258s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:24 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:45:24 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:25 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa Jul 08 01:45:25 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af211c-3248-43ce-ad04-e79da8438c80]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:25 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD Jul 08 01:45:25 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Flow 'volume_create_manager' (a1cb113a-1555-4c29-b2c0-3b7db42b8e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f42d25-e393-439b-94ac-7d6cb73b5743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f42d25-e393-439b-94ac-7d6cb73b5743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512c5b34fbee4064b3ddbb66f2a17f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:26Z,use_quota=True,user_id='2e974945cc5a4fd9a0bf5935c40bad0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3338992-c22d-4a9f-955d-450df466420e),volume_type_id=b3338992-c22d-4a9f-955d-450df466420e)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29da747-8d9f-4651-abd5-2cdb32f6b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29da747-8d9f-4651-abd5-2cdb32f6b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f9e37f-4e36-4a7a-b8cd-8a88569eb199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:45:25 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa" returned: 0 in 0.880s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.903s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Creating offline snapshot 19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 of volume 610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef7b8ec-2460-435f-a5de-27682e235611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb121d0-c2c0-4f34-a522-2289f34e05aa', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc04b61-d1b5-4cb0-a630-7a213d92882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[562929c8-4d15-41ae-b73f-ed6fd063feaf]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume volume-edb121d0-c2c0-4f34-a522-2289f34e05aa (edb121d0-c2c0-4f34-a522-2289f34e05aa): created successfully Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc04b61-d1b5-4cb0-a630-7a213d92882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (2b8eb974-59dd-4810-95d4-faec7de10e3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-556b234c-70d2-4847-9fc4-c5f11e3991cd tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created volume successfully. Jul 08 01:45:26 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD" returned: 0 in 0.982s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:26 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d Jul 08 01:45:26 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:26 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD Jul 08 01:45:26 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f9e37f-4e36-4a7a-b8cd-8a88569eb199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1', 'volume_name': 'volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1', 'volume_size': 1, 'image_id': 'ca0259c3-ad40-4492-b317-4a31bdba143f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca0259c3-ad40-4492-b317-4a31bdba143f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3128a734a23bcfed6ff97d11b271acde', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '512c5b34fbee4064b3ddbb66f2a17f80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b17a1e3a21ce73f0e91816a975b9036334110596931d361a57406f4eb680744d10fcf79c21251e719c198a6f45c02ac85cecc639f82b8340354c85c07b943bea', 'id': 'ca0259c3-ad40-4492-b317-4a31bdba143f', 'created_at': datetime.datetime(2026, 7, 7, 23, 45, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca0259c3-ad40-4492-b317-4a31bdba143f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef903765-fde8-4d8c-a90c-401ac1b96553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef903765-fde8-4d8c-a90c-401ac1b96553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7945bb06-f45d-4aee-ab18-7f5d27272096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Volume 0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1', 'volume_size': 1, 'image_id': 'ca0259c3-ad40-4492-b317-4a31bdba143f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca0259c3-ad40-4492-b317-4a31bdba143f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3128a734a23bcfed6ff97d11b271acde', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '512c5b34fbee4064b3ddbb66f2a17f80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b17a1e3a21ce73f0e91816a975b9036334110596931d361a57406f4eb680744d10fcf79c21251e719c198a6f45c02ac85cecc639f82b8340354c85c07b943bea', 'id': 'ca0259c3-ad40-4492-b317-4a31bdba143f', 'created_at': datetime.datetime(2026, 7, 7, 23, 45, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca0259c3-ad40-4492-b317-4a31bdba143f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Trying to clone 0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 from image ca0259c3-ad40-4492-b317-4a31bdba143f at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca0259c3-ad40-4492-b317-4a31bdba143f', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:45:26 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2641077e-524f-4981-ab7e-c026c9035944]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:26 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD Jul 08 01:45:26 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:26 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" returned: 0 in 0.991s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:26 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 1G Jul 08 01:45:26 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:27 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD" returned: 1 in 1.005s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Temporary image de9497d9-eaf4-480f-bd06-ff476adfbe2a is fetched for user c37fb00b2dfb491b8fa92076246da022. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc43d0a-789f-492e-a1ee-9762db170b2c]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:27 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD Jul 08 01:45:27 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:27 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD" returned: 0 in 0.965s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:27 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD Jul 08 01:45:27 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (9362503b-3687-4d67-888f-bacdd051fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fe554e-57db-41be-a659-11b43b15a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fe554e-57db-41be-a659-11b43b15a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1654803206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cb0a38-8515-4109-a1e5-35f9f63d34dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:28Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13944704-4b23-4c9b-ad85-21af3cf7b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13944704-4b23-4c9b-ad85-21af3cf7b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae19235-5bd8-46ee-b202-a7dda4f642ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae19235-5bd8-46ee-b202-a7dda4f642ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8cb0a38-8515-4109-a1e5-35f9f63d34dc', 'volume_name': 'volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e41bd58-8f6a-4be4-aa6a-b4fe5f57fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e41bd58-8f6a-4be4-aa6a-b4fe5f57fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c816b639-7a54-4c50-a5c1-7a7a3aa8f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:27 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume c8cb0a38-8515-4109-a1e5-35f9f63d34dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc', 'volume_size': 1} Jul 08 01:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:28 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD" returned: 0 in 1.074s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (6376b6d6-e980-4eb7-9d55-b655800d11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:28 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b74a14-c605-42ce-8608-a8201dff7d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 1G" returned: 0 in 1.441s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b74a14-c605-42ce-8608-a8201dff7d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862152914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85eb957d-2d51-4864-91b3-a68a51fbb4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:28Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:28 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 Jul 08 01:45:28 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d50b0f3-fd82-4365-8914-347f01805bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d50b0f3-fd82-4365-8914-347f01805bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:28 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9ed2b5-aff1-41ff-9760-c948f513b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:28 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9ed2b5-aff1-41ff-9760-c948f513b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85eb957d-2d51-4864-91b3-a68a51fbb4fc', 'volume_name': 'volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8951bee5-2f59-45cb-bbb2-b0ec66c87468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8951bee5-2f59-45cb-bbb2-b0ec66c87468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa8207f-0831-4030-a239-b66e7a97e654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume 85eb957d-2d51-4864-91b3-a68a51fbb4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc', 'volume_size': 1} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:28 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD" returned: 1 in 1.328s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Temporary image ca0259c3-ad40-4492-b317-4a31bdba143f is fetched for user 2e974945cc5a4fd9a0bf5935c40bad0d. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[af193fae-4914-42bd-b7c9-f6610aaf3344]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (2a4ce20a-3ed9-483c-b467-c402cd74ae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a5827b-d2b4-4c73-a2b0-73f7f3f8b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD Jul 08 01:45:29 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a5827b-d2b4-4c73-a2b0-73f7f3f8b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513550942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe900b6-02e9-4680-aaec-ef8ec2708421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:29Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435698fa-168e-413e-8439-7b655762fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435698fa-168e-413e-8439-7b655762fa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b804f0-cf86-4fe5-8490-d02b0ce880f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b804f0-cf86-4fe5-8490-d02b0ce880f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fe900b6-02e9-4680-aaec-ef8ec2708421', 'volume_name': 'volume-3fe900b6-02e9-4680-aaec-ef8ec2708421', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6cfef9-1f13-48d4-8eaf-181699776f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6cfef9-1f13-48d4-8eaf-181699776f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c16c401-b281-4b6d-aece-117147d48bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume 3fe900b6-02e9-4680-aaec-ef8ec2708421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fe900b6-02e9-4680-aaec-ef8ec2708421', 'volume_size': 1} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:29 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD" returned: 1 in 1.283s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:29 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (b3c45fe0-5c81-4c28-ac7d-68959be629dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b468678c-cc0d-4b4d-8865-437cd7a2899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8" returned: 0 in 1.204s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:29 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 is being set with open permissions: ugo+rw Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b468678c-cc0d-4b4d-8865-437cd7a2899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-31309673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011b351d-81bb-4be0-8470-10a3b5139ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:29Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:29 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 Jul 08 01:45:29 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6b67a3-076b-4a9c-bd9c-6ed87bf41d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6b67a3-076b-4a9c-bd9c-6ed87bf41d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e704f85-6646-47ac-b5e6-8c3c0353838c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e704f85-6646-47ac-b5e6-8c3c0353838c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011b351d-81bb-4be0-8470-10a3b5139ac9', 'volume_name': 'volume-011b351d-81bb-4be0-8470-10a3b5139ac9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0c233b-18d4-4257-af1e-dab18660d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0c233b-18d4-4257-af1e-dab18660d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da788911-d00e-43a6-9531-e75fd54b1721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume 011b351d-81bb-4be0-8470-10a3b5139ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011b351d-81bb-4be0-8470-10a3b5139ac9', 'volume_size': 1} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:29 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD" returned: 0 in 1.069s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:30 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:30 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (5ecc70cf-cd76-4203-9165-f25aa598628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04b2c13-e355-40e6-8ece-c4b92e68531c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04b2c13-e355-40e6-8ece-c4b92e68531c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062000655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35d4d03-8304-4ac0-bfa9-b73330b69248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:30Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4938923c-f3bc-4528-9d82-92f2f29ee294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4938923c-f3bc-4528-9d82-92f2f29ee294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6aaee64-72c4-4ee2-8d59-2ef052ee8cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6aaee64-72c4-4ee2-8d59-2ef052ee8cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b35d4d03-8304-4ac0-bfa9-b73330b69248', 'volume_name': 'volume-b35d4d03-8304-4ac0-bfa9-b73330b69248', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f637a935-e639-495e-8076-1fe8daff8e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f637a935-e639-495e-8076-1fe8daff8e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2158ec4f-774b-4123-a49b-e3bc523037e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume b35d4d03-8304-4ac0-bfa9-b73330b69248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b35d4d03-8304-4ac0-bfa9-b73330b69248', 'volume_size': 1} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:30 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:30 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.info Jul 08 01:45:30 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:30 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD" returned: 1 in 0.871s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:31 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.info" returned: 0 in 0.701s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:31 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.info is being set with open permissions: ugo+rw Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:31 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.info Jul 08 01:45:31 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:31 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.info" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.965s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.075s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1654803206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cb0a38-8515-4109-a1e5-35f9f63d34dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:28Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Creating volume c8cb0a38-8515-4109-a1e5-35f9f63d34dc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:31 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:31 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc 1073741824 Jul 08 01:45:31 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eb26896a-001d-403d-b07d-de86f2780f8c tempest-VolumeDependencyTests-1942376705 None] Create snapshot completed successfully Jul 08 01:45:32 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc 1073741824" returned: 0 in 1.017s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:32 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc Jul 08 01:45:32 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Flow 'volume_create_manager' (1f896206-868f-4a4d-aa9b-2caf68987039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd37d418-38cc-46aa-a3f5-83493a77c162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd37d418-38cc-46aa-a3f5-83493a77c162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-347396660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c47a9a-8439-437e-8a9b-f6789ca4f3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a904924f166b497c866de0e4e5056484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:33Z,use_quota=True,user_id='f83b856510624aea85c479fbee843128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52680f6-5124-4375-937f-dd1591460501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52680f6-5124-4375-937f-dd1591460501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62bcc7f-0c2b-4b0a-a471-91c276297998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62bcc7f-0c2b-4b0a-a471-91c276297998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '56c47a9a-8439-437e-8a9b-f6789ca4f3d5', 'volume_name': 'volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5', 'volume_size': 1, 'snapshot_id': '19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1164b63-5c53-48a9-82b4-d8564bf23eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1164b63-5c53-48a9-82b4-d8564bf23eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd43f21-89cd-48ee-b53e-12117015f7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:33 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Volume 56c47a9a-8439-437e-8a9b-f6789ca4f3d5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5', 'volume_size': 1, 'snapshot_id': '19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8'} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:33 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.182s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862152914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85eb957d-2d51-4864-91b3-a68a51fbb4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:28Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Creating volume 85eb957d-2d51-4864-91b3-a68a51fbb4fc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:33 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c816b639-7a54-4c50-a5c1-7a7a3aa8f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:33 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc 1073741824 Jul 08 01:45:33 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f215377f-c8bf-4a5e-b581-7dd9233c0f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:33 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc (c8cb0a38-8515-4109-a1e5-35f9f63d34dc): created successfully Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f215377f-c8bf-4a5e-b581-7dd9233c0f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (9362503b-3687-4d67-888f-bacdd051fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e9cb2508-0e2d-43b6-9e6a-01c176e225e9 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created volume successfully. Jul 08 01:45:34 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc 1073741824" returned: 0 in 0.902s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:34 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc Jul 08 01:45:34 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:35 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc" returned: 0 in 0.688s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.251s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513550942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe900b6-02e9-4680-aaec-ef8ec2708421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:29Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Creating volume 3fe900b6-02e9-4680-aaec-ef8ec2708421 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:35 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa8207f-0831-4030-a239-b66e7a97e654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd64f0c-fcac-4e48-a558-ab652570721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:35 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 1073741824 Jul 08 01:45:35 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:35 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc (85eb957d-2d51-4864-91b3-a68a51fbb4fc): created successfully Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd64f0c-fcac-4e48-a558-ab652570721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (6376b6d6-e980-4eb7-9d55-b655800d11ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-98279330-c5d5-4e64-b329-1ace3ae305ed tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created volume successfully. Jul 08 01:45:36 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 1073741824" returned: 0 in 0.931s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:36 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 Jul 08 01:45:36 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:36 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421" returned: 0 in 0.668s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.462s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdbf471-b94f-4d23-92af-31f4985e1f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5eb1b06350848e19690d2403f8926a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:24Z,use_quota=True,user_id='c37fb00b2dfb491b8fa92076246da022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Creating volume cbdbf471-b94f-4d23-92af-31f4985e1f95 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:36 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:37 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 1073741824 Jul 08 01:45:37 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c16c401-b281-4b6d-aece-117147d48bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe900b6-02e9-4680-aaec-ef8ec2708421', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aeb5bc-dec3-4fc2-91dd-1564fc6a45e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:37 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 (3fe900b6-02e9-4680-aaec-ef8ec2708421): created successfully Jul 08 01:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aeb5bc-dec3-4fc2-91dd-1564fc6a45e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (2a4ce20a-3ed9-483c-b467-c402cd74ae95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-57cdd446-07c5-4315-b9cf-ff5c0c41af0e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created volume successfully. Jul 08 01:45:37 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 1073741824" returned: 0 in 0.951s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:38 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 Jul 08 01:45:38 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:38 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95" returned: 0 in 0.704s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-31309673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011b351d-81bb-4be0-8470-10a3b5139ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:29Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Creating volume 011b351d-81bb-4be0-8470-10a3b5139ac9 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:38 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:38 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9 1073741824 Jul 08 01:45:38 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Attempting download of de9497d9-eaf4-480f-bd06-ff476adfbe2a ((None, [{'url': 'file:///opt/stack/data/glance/images/de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'metadata': {}}])) to volume cbdbf471-b94f-4d23-92af-31f4985e1f95. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e75302-f437-4471-a854-8a25b1d92bfa]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de9497d9-eaf4-480f-bd06-ff476adfbe2a_f5od_w9i {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:38 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de9497d9-eaf4-480f-bd06-ff476adfbe2a_f5od_w9i Jul 08 01:45:38 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:39 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de9497d9-eaf4-480f-bd06-ff476adfbe2a_f5od_w9i" returned: 0 in 0.871s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de9497d9-eaf4-480f-bd06-ff476adfbe2a_f5od_w9i {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:39 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9 1073741824" returned: 0 in 1.002s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:39 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9 Jul 08 01:45:39 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:39 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de9497d9-eaf4-480f-bd06-ff476adfbe2a_f5od_w9i Jul 08 01:45:39 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:40 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.374s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062000655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35d4d03-8304-4ac0-bfa9-b73330b69248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b82f33155d42c4a96d7d18aca5c91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:30Z,use_quota=True,user_id='284c006a70a0475eb618fe2dcded4c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Creating volume b35d4d03-8304-4ac0-bfa9-b73330b69248 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:40 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:40 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de9497d9-eaf4-480f-bd06-ff476adfbe2a_f5od_w9i" returned: 1 in 0.891s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de9497d9-eaf4-480f-bd06-ff476adfbe2a_f5od_w9i' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a871cd-7855-47d3-a148-b46a1fd43b54]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:40 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 1073741824 Jul 08 01:45:40 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da788911-d00e-43a6-9531-e75fd54b1721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011b351d-81bb-4be0-8470-10a3b5139ac9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523d9f57-4a1c-46e2-b7a6-7d05c6bdac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume volume-011b351d-81bb-4be0-8470-10a3b5139ac9 (011b351d-81bb-4be0-8470-10a3b5139ac9): created successfully Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523d9f57-4a1c-46e2-b7a6-7d05c6bdac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (b3c45fe0-5c81-4c28-ac7d-68959be629dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6e085575-249c-4e7b-9e57-9c65fa8ddc33 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created volume successfully. Jul 08 01:45:40 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD Jul 08 01:45:40 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:41 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD" returned: 0 in 0.825s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:41 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD Jul 08 01:45:41 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:41 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 1073741824" returned: 0 in 1.001s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:41 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 Jul 08 01:45:41 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:42 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD" returned: 1 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] de9497d9-eaf4-480f-bd06-ff476adfbe2a was raw, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:42 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 Jul 08 01:45:42 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:42 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.534s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512c5b34fbee4064b3ddbb66f2a17f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:26Z,use_quota=True,user_id='2e974945cc5a4fd9a0bf5935c40bad0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3338992-c22d-4a9f-955d-450df466420e),volume_type_id=b3338992-c22d-4a9f-955d-450df466420e)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Creating volume 0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:42 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2158ec4f-774b-4123-a49b-e3bc523037e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35d4d03-8304-4ac0-bfa9-b73330b69248', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:42 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 1073741824 Jul 08 01:45:42 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0735a0e3-ffe5-4e51-9597-63fc559de359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:42 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Volume volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 (b35d4d03-8304-4ac0-bfa9-b73330b69248): created successfully Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0735a0e3-ffe5-4e51-9597-63fc559de359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Flow 'volume_create_manager' (5ecc70cf-cd76-4203-9165-f25aa598628b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3f9e5aab-60ac-4fe9-90a4-0e320405e83e tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created volume successfully. Jul 08 01:45:43 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95" returned: 0 in 0.870s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de9497d9-eaf4-480f-bd06-ff476adfbe2a_n9c73ldcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:45:43 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-b35d4d03-8304-4ac0-bfa9-b73330b69248-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:43 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 1G Jul 08 01:45:43 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-b35d4d03-8304-4ac0-bfa9-b73330b69248-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-quobyte-b35d4d03-8304-4ac0-bfa9-b73330b69248" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-b35d4d03-8304-4ac0-bfa9-b73330b69248" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5ecf0f-f884-494d-ab9d-22328ebee74f]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:43 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 Jul 08 01:45:43 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:43 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 1073741824" returned: 0 in 1.089s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:43 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 Jul 08 01:45:43 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:43 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 1G" returned: 0 in 0.809s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2281e70-50b0-4879-b635-1e087ee662ea]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:44 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 Jul 08 01:45:44 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:44 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" returned: 0 in 0.731s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.132s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "cinder-quobyte-19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Creating volume 56c47a9a-8439-437e-8a9b-f6789ca4f3d5 from snapshot 19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:44 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "cinder-quobyte-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Attempting download of ca0259c3-ad40-4492-b317-4a31bdba143f ((None, [{'url': 'file:///opt/stack/data/glance/images/ca0259c3-ad40-4492-b317-4a31bdba143f', 'metadata': {}}])) to volume 0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248" returned: 0 in 0.996s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] snapshot: 19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8, volume: 56c47a9a-8439-437e-8a9b-f6789ca4f3d5, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:45:44 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248 Jul 08 01:45:44 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d52aaff-ec9b-4c1a-ad0f-bd778175a5b9]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca0259c3-ad40-4492-b317-4a31bdba143f_o7xmz601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[11de5378-fe39-43fb-a701-6d491eb37eb9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:44 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca0259c3-ad40-4492-b317-4a31bdba143f_o7xmz601 Jul 08 01:45:44 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:44 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 Jul 08 01:45:44 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:44 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95" returned: 0 in 0.912s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:45 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 Jul 08 01:45:45 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:45 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b35d4d03-8304-4ac0-bfa9-b73330b69248" returned: 0 in 0.943s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-b35d4d03-8304-4ac0-bfa9-b73330b69248" released by "delete_volume" :: held 1.986s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:45 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca0259c3-ad40-4492-b317-4a31bdba143f_o7xmz601" returned: 0 in 0.921s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca0259c3-ad40-4492-b317-4a31bdba143f_o7xmz601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created reservations ['2bffbf5f-4dc3-40eb-8563-6f0e0a80d54c', '9b9da840-e71d-4f09-9138-8ad311e19b47', '76ea84d4-e197-45c3-b3e7-497203725604', 'bec2ba5a-b911-4cfb-b8ad-fe53578baa80'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:45 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8" returned: 0 in 1.007s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b641a59-fb2a-44d0-a2e3-ae961c010ab9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:45 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca0259c3-ad40-4492-b317-4a31bdba143f_o7xmz601 Jul 08 01:45:45 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:45 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:45 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-011b351d-81bb-4be0-8470-10a3b5139ac9-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-011b351d-81bb-4be0-8470-10a3b5139ac9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-quobyte-011b351d-81bb-4be0-8470-10a3b5139ac9" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-011b351d-81bb-4be0-8470-10a3b5139ac9" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:45 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d Jul 08 01:45:45 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62d54ac-6997-4a2d-bbb0-cc3fd5b52de5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:45 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9 Jul 08 01:45:45 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:46 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95" returned: 1 in 1.269s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Downloaded image de9497d9-eaf4-480f-bd06-ff476adfbe2a ((None, [{'url': 'file:///opt/stack/data/glance/images/de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'metadata': {}}])) to volume cbdbf471-b94f-4d23-92af-31f4985e1f95 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Temporary image de9497d9-eaf4-480f-bd06-ff476adfbe2a for user c37fb00b2dfb491b8fa92076246da022 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Marking volume cbdbf471-b94f-4d23-92af-31f4985e1f95 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Copying metadata from image de9497d9-eaf4-480f-bd06-ff476adfbe2a to cbdbf471-b94f-4d23-92af-31f4985e1f95. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Creating volume glance metadata for volume cbdbf471-b94f-4d23-92af-31f4985e1f95 backed by image de9497d9-eaf4-480f-bd06-ff476adfbe2a with: {'image_id': 'de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '38b6dca7c315775e81200e21217e9eec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:45:46 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca0259c3-ad40-4492-b317-4a31bdba143f_o7xmz601" returned: 1 in 1.011s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca0259c3-ad40-4492-b317-4a31bdba143f_o7xmz601' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5c5de1-6d66-479b-a135-b9db56023901]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c2948d-a1f0-498d-8710-efe90226d565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdbf471-b94f-4d23-92af-31f4985e1f95', 'volume_size': 1, 'image_id': 'de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38b6dca7c315775e81200e21217e9eec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5eb1b06350848e19690d2403f8926a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11b414035c6ffd0b011be1279563d74648f98aca014583cc4cd5bf7525e8797b3175c22107a597c1cf015f95242332ec898117eb5251103b386f2b74c11e5ac4', 'id': 'de9497d9-eaf4-480f-bd06-ff476adfbe2a', 'created_at': datetime.datetime(2026, 7, 7, 23, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de9497d9-eaf4-480f-bd06-ff476adfbe2a/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b11e09d-2c2b-4e62-83fc-72421175c7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:46 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Volume volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 (cbdbf471-b94f-4d23-92af-31f4985e1f95): created successfully Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b11e09d-2c2b-4e62-83fc-72421175c7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Flow 'volume_create_manager' (c51041ee-eeb8-4ab7-a4f7-836e3947e973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.947s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Deleted volume successfully. Jul 08 01:45:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-66b6fa6c-af4b-4a56-ad51-cf5933960955 tempest-VolumeImageDependencyTests-418526813 None] Created volume successfully. Jul 08 01:45:46 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD Jul 08 01:45:46 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-78c34c9e-a0a0-493f-831e-d844f9698035 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-b35d4d03-8304-4ac0-bfa9-b73330b69248-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:46 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9" returned: 0 in 1.070s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:46 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" returned: 0 in 1.333s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:46 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9 Jul 08 01:45:46 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:46 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 Jul 08 01:45:46 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Acquiring lock "cinder-cbdbf471-b94f-4d23-92af-31f4985e1f95-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Lock "cinder-cbdbf471-b94f-4d23-92af-31f4985e1f95-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Acquiring lock "cinder-quobyte-cbdbf471-b94f-4d23-92af-31f4985e1f95" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Lock "cinder-quobyte-cbdbf471-b94f-4d23-92af-31f4985e1f95" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f2c131-6c48-401a-aba0-74b8195d6176]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:47 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD" returned: 0 in 1.053s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:47 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 Jul 08 01:45:47 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:47 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD Jul 08 01:45:47 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:47 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-011b351d-81bb-4be0-8470-10a3b5139ac9" returned: 0 in 0.857s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-011b351d-81bb-4be0-8470-10a3b5139ac9" released by "delete_volume" :: held 1.993s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created reservations ['c952b890-e374-4ca4-bb89-fb66974dd20b', 'bd2f9cce-24fe-4257-a730-c61ccedaf0ea', 'da505f59-86c8-419a-b4b1-d63c8e3d4616', '9c499242-74ff-4245-8bbc-a260c066fdd3'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:47 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:47 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-3fe900b6-02e9-4680-aaec-ef8ec2708421-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-3fe900b6-02e9-4680-aaec-ef8ec2708421-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-quobyte-3fe900b6-02e9-4680-aaec-ef8ec2708421" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-3fe900b6-02e9-4680-aaec-ef8ec2708421" acquired by "delete_volume" :: waited 0.054s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[872b5548-807c-4546-8e4c-0ffe28d48ae3]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:48 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 Jul 08 01:45:48 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:49 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95" returned: 0 in 2.329s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:49 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD" returned: 1 in 2.360s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:49 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] ca0259c3-ad40-4492-b317-4a31bdba143f was raw, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:49 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 2.030s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:49 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 Jul 08 01:45:49 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Deleted volume successfully. Jul 08 01:45:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d94ef763-54be-41a9-9420-3bb72a202da7 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-011b351d-81bb-4be0-8470-10a3b5139ac9-delete_volume" released by "delete_volume" :: held 4.374s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:50 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 Jul 08 01:45:50 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:51 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421" returned: 0 in 2.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:51 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421 Jul 08 01:45:51 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:51 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" returned: 0 in 1.647s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:51 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca0259c3-ad40-4492-b317-4a31bdba143f_5rhh72qfdevstack@QuobyteHD, size 0.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:45:51 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:51 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 1G Jul 08 01:45:51 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:52 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95" returned: 1 in 2.792s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:52 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95 Jul 08 01:45:52 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:53 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 1G" returned: 0 in 2.118s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6834ae6a-bf1c-4395-b898-224d410b1592]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:53 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3fe900b6-02e9-4680-aaec-ef8ec2708421" returned: 0 in 2.471s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:53 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:53 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-3fe900b6-02e9-4680-aaec-ef8ec2708421" released by "delete_volume" :: held 5.388s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=107,cinder:DELETE=8,cinder:SELECT=76,cinder:INSERT=24 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:DELETE=11,cinder:UPDATE=89,cinder:SELECT=72,cinder:INSERT=29 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:45:53 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 Jul 08 01:45:53 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:53 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" returned: 0 in 7.030s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a362d1c8-84f6-44d6-9455-c7c31d8286f4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:53 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created reservations ['9e27e1ac-d30b-4d67-9053-bfd75818889c', 'f720fe64-a25c-4309-b52e-63871314ba06', 'c3bf7cb9-d8d1-426d-9115-c5fbaffaa066', '318eba8b-20e1-4d40-825e-593c4910f69f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:54 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cbdbf471-b94f-4d23-92af-31f4985e1f95" returned: 0 in 1.577s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Lock "cinder-quobyte-cbdbf471-b94f-4d23-92af-31f4985e1f95" released by "delete_volume" :: held 6.842s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:54 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d Jul 08 01:45:54 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:54 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:54 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Created reservations ['ad94535e-6b59-40f3-8541-b5305adada9c', '8c69a2ee-5136-44fd-939e-d43cd3e761da', 'd9d6a3bb-24d4-4b60-960a-30d9804aa950', 'e83c9c3b-9225-48e3-8baa-c82998abf5e4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-85eb957d-2d51-4864-91b3-a68a51fbb4fc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-85eb957d-2d51-4864-91b3-a68a51fbb4fc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:54 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:54 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-quobyte-85eb957d-2d51-4864-91b3-a68a51fbb4fc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-85eb957d-2d51-4864-91b3-a68a51fbb4fc" acquired by "delete_volume" :: waited 0.052s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b298fc7-f91c-42d0-9cd7-783acc6f0b58]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:54 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" returned: 0 in 1.342s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:55 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.361s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:45:55 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc Jul 08 01:45:55 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:55 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.996s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Deleted volume successfully. Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9f436089-e2f1-4117-be43-0808afeafc3c tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-3fe900b6-02e9-4680-aaec-ef8ec2708421-delete_volume" released by "delete_volume" :: held 6.987s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:55 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 Jul 08 01:45:55 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:55 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" returned: 0 in 1.593s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:45:55 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Converted 1024.00 MB image at 145.63 MB/s Jul 08 01:45:55 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 is being set with open permissions: ugo+rw Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:55 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 Jul 08 01:45:55 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:55 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.163s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Deleted volume successfully. Jul 08 01:45:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75e42b2b-553b-43da-a0a4-c26ba2464eca tempest-VolumeImageDependencyTests-418526813 None] Lock "cinder-cbdbf471-b94f-4d23-92af-31f4985e1f95-delete_volume" released by "delete_volume" :: held 8.674s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:56 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc" returned: 0 in 1.276s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:56 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc Jul 08 01:45:56 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:56 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:56 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" returned: 1 in 1.286s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Downloaded image ca0259c3-ad40-4492-b317-4a31bdba143f ((None, [{'url': 'file:///opt/stack/data/glance/images/ca0259c3-ad40-4492-b317-4a31bdba143f', 'metadata': {}}])) to volume 0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Temporary image ca0259c3-ad40-4492-b317-4a31bdba143f for user 2e974945cc5a4fd9a0bf5935c40bad0d is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Marking volume 0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" returned: 0 in 0.836s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" released by "_copy_volume_from_snapshot" :: held 11.974s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Copying metadata from image ca0259c3-ad40-4492-b317-4a31bdba143f to 0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Creating volume glance metadata for volume 0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 backed by image ca0259c3-ad40-4492-b317-4a31bdba143f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ca0259c3-ad40-4492-b317-4a31bdba143f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3128a734a23bcfed6ff97d11b271acde', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" released by "_create_volume_from_snapshot" :: held 12.037s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.069s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd43f21-89cd-48ee-b53e-12117015f7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5', 'volume_size': 1, 'snapshot_id': '19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c075dccc-9160-4014-9f2d-bbda02ed3f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Volume volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 (56c47a9a-8439-437e-8a9b-f6789ca4f3d5): created successfully Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c075dccc-9160-4014-9f2d-bbda02ed3f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Flow 'volume_create_manager' (1f896206-868f-4a4d-aa9b-2caf68987039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ede7da03-fa21-4886-a225-f39f0817c050 tempest-VolumeDependencyTests-1942376705 None] Created volume successfully. Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7945bb06-f45d-4aee-ab18-7f5d27272096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1', 'volume_size': 1, 'image_id': 'ca0259c3-ad40-4492-b317-4a31bdba143f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca0259c3-ad40-4492-b317-4a31bdba143f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3128a734a23bcfed6ff97d11b271acde', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '512c5b34fbee4064b3ddbb66f2a17f80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b17a1e3a21ce73f0e91816a975b9036334110596931d361a57406f4eb680744d10fcf79c21251e719c198a6f45c02ac85cecc639f82b8340354c85c07b943bea', 'id': 'ca0259c3-ad40-4492-b317-4a31bdba143f', 'created_at': datetime.datetime(2026, 7, 7, 23, 45, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca0259c3-ad40-4492-b317-4a31bdba143f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9df03e3-027e-4934-b8d0-89d4d91cd633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Volume volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 (0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1): created successfully Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9df03e3-027e-4934-b8d0-89d4d91cd633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Flow 'volume_create_manager' (a1cb113a-1555-4c29-b2c0-3b7db42b8e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3d35e4a1-b63e-431a-9d54-3ff938028389 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Created volume successfully. Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Acquiring lock "cinder-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "cinder-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Acquiring lock "cinder-quobyte-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "cinder-quobyte-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[56470199-d1d1-4e26-9939-8cd87b6c5d68]: (4, 'raw') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:56 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-85eb957d-2d51-4864-91b3-a68a51fbb4fc" returned: 0 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-85eb957d-2d51-4864-91b3-a68a51fbb4fc" released by "delete_volume" :: held 2.135s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:56 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created reservations ['540696fd-f226-417f-bcac-654dfc7661aa', '70da4e67-ee62-4977-8511-769a424c2d69', '27c1bb93-218c-498b-9636-9b7761e0fc4d', 'a5cf4b7f-16e0-419d-bb8a-6e1053b51359'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:57 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 Jul 08 01:45:57 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:57 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:45:57 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "cinder-19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "cinder-quobyte-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "cinder-quobyte-19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Deleting offline snapshot 19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 of volume 610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] snapshot_file for this snap is: volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb63a4f7-23e5-4d19-8ca2-7f6bd5f5d6ec]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:57 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 Jul 08 01:45:57 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-c8cb0a38-8515-4109-a1e5-35f9f63d34dc-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:57 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" returned: 0 in 1.105s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-c8cb0a38-8515-4109-a1e5-35f9f63d34dc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-quobyte-c8cb0a38-8515-4109-a1e5-35f9f63d34dc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-c8cb0a38-8515-4109-a1e5-35f9f63d34dc" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d515cb94-bd5e-404f-8cdf-37adee672b42]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:58 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 Jul 08 01:45:58 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:58 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.150s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Deleted volume successfully. Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e0fed772-775e-41bf-8cc3-eac99b89b223 tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-85eb957d-2d51-4864-91b3-a68a51fbb4fc-delete_volume" released by "delete_volume" :: held 3.819s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:58 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc Jul 08 01:45:58 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:58 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8" returned: 0 in 1.065s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ea9e5e-61cc-41c3-a4d5-c3b5215ac8e7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:58 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d Jul 08 01:45:58 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:59 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" returned: 1 in 1.164s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:59 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1 Jul 08 01:45:59 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:59 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc" returned: 0 in 1.225s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:59 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc Jul 08 01:45:59 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:59 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" returned: 0 in 0.865s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:59 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 Jul 08 01:45:59 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:00 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" returned: 0 in 0.974s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "cinder-quobyte-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1" released by "delete_volume" :: held 3.334s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Created reservations ['b0389c60-61ba-4ac7-ad2b-85f47cbd2a2f', 'de9eb12c-6f81-4adf-8466-433d74d9adbd', '105b5ae7-0c09-4c0a-ba8d-8f7f82b42900', 'f8dbd1c3-9020-413e-804f-de8e99981751'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:00 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-c8cb0a38-8515-4109-a1e5-35f9f63d34dc" returned: 0 in 0.979s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-c8cb0a38-8515-4109-a1e5-35f9f63d34dc" released by "delete_volume" :: held 2.264s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:00 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:00 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created reservations ['9c91173f-d0ef-4731-a2ae-15b3bf1a06b2', 'a6b62046-fc97-4e03-ab01-645595a3464b', '1268291f-2092-4beb-afac-7224ebfa7631', '2248a2a0-514d-49e6-b155-caa520ad8f01'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:00 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:00 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:00 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8" returned: 0 in 1.118s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:00 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8 Jul 08 01:46:00 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:01 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Deleted volume successfully. Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-39ea6f8a-2c94-413d-bda4-65bb2a8b5f31 tempest-VolumeAndVolumeTypeFromImageTest-1057081402 None] Lock "cinder-0f38c969-4ab9-4ffd-919a-0cb06ad8e4b1-delete_volume" released by "delete_volume" :: held 4.442s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:01 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.796s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Deleted volume successfully. Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-171054fa-2d1e-465e-a60e-eaaeadc3e1ea tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-c8cb0a38-8515-4109-a1e5-35f9f63d34dc-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-edb121d0-c2c0-4f34-a522-2289f34e05aa-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-edb121d0-c2c0-4f34-a522-2289f34e05aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "cinder-quobyte-edb121d0-c2c0-4f34-a522-2289f34e05aa" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-edb121d0-c2c0-4f34-a522-2289f34e05aa" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f67c784-5a8a-4e83-820d-5fe379ef629b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:01 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d.19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8" returned: 0 in 0.895s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8" released by "_delete_snapshot" :: held 4.137s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" released by "delete_snapshot" :: held 4.178s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:01 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa Jul 08 01:46:01 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Created reservations ['cdbfb649-e25c-4df0-aab3-1af6af0f6b21', 'f2849f43-7dbb-433c-9a7a-c6cc09692435', '64755526-f15b-4b1c-8fd2-99988950d829', '4de166d5-c677-43cf-8975-3bd7564e9502'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Delete snapshot completed successfully. Jul 08 01:46:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5cab2b49-335f-4381-be94-6d41558ed276 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-19a0d0f0-85d7-4c0a-9cf0-e0f04b6296a8-delete_snapshot" released by "delete_snapshot" :: held 4.410s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:02 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa" returned: 0 in 1.000s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:02 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa Jul 08 01:46:02 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "cinder-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "cinder-quobyte-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb4fdbd-75e8-429f-9ccb-dba09b9d7be3]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:03 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d Jul 08 01:46:03 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:03 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-edb121d0-c2c0-4f34-a522-2289f34e05aa" returned: 0 in 0.857s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-quobyte-edb121d0-c2c0-4f34-a522-2289f34e05aa" released by "delete_volume" :: held 1.926s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Created reservations ['5acbb775-4f8c-4707-a1fe-1c7b1e671840', '0e92fc1f-efd7-42e8-81c1-0e07b6333531', '9852fbdf-a0e1-4449-9b84-3574de178ef6', '2c4a3c76-d15b-4a93-b530-8f3369e5e99e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:03 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:03 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:04 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" returned: 0 in 1.349s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:04 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d Jul 08 01:46:04 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:04 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.904s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:04 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Deleted volume successfully. Jul 08 01:46:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6f5ca0c0-e0cb-47b2-b3bd-4587c3c6dd1b tempest-CreateVolumesFromSourceVolumeTest-512326052 None] Lock "cinder-edb121d0-c2c0-4f34-a522-2289f34e05aa-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:05 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" returned: 0 in 0.896s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d" released by "delete_volume" :: held 2.351s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Created reservations ['48a891d3-8816-4508-9141-5aa03aec34c5', '5fb64c49-0dbe-4eb9-af1e-81f55d1c102c', '01d9cb93-c394-4b2c-8da0-64dca51fd219', '40ac74ee-4583-4344-874b-6912fe876048'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:05 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:05 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "cinder-56c47a9a-8439-437e-8a9b-f6789ca4f3d5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-56c47a9a-8439-437e-8a9b-f6789ca4f3d5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "cinder-quobyte-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b050d3-d5cb-4241-8af8-ea703eb1a36a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:06 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.945s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:06 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Deleted volume successfully. Jul 08 01:46:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3c9651c9-6853-40e4-89b8-69ed19e97169 tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-610d0ae0-7744-43bd-93ee-fe6bd9cf9e1d-delete_volume" released by "delete_volume" :: held 3.637s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:06 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 Jul 08 01:46:06 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:07 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" returned: 0 in 0.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:07 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5 Jul 08 01:46:07 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:08 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-quobyte-56c47a9a-8439-437e-8a9b-f6789ca4f3d5" released by "delete_volume" :: held 1.804s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Created reservations ['69cead46-368d-499c-8557-c2bda27ac9f6', '1509b037-8995-416b-b704-9526d38aa29a', 'bfe5a385-3ef4-4557-8ed7-81c7d81e2a59', '33f35593-2bf9-4464-92ef-ea7fc4360800'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Flow 'volume_create_manager' (db7977ba-5a3d-4e3f-a922-6685188cc2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f81e327-817e-4f82-8dc3-80d155e8593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f81e327-817e-4f82-8dc3-80d155e8593b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478204870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e6714e-7a9a-4b65-bca4-39952879577c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5713bb6c0ad1444193acafa8b1d1dbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:08Z,use_quota=True,user_id='7d7c996c1d784f6da0e337fdd0530c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcfe1d1-e4c7-48b0-8197-73c7df5b82e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcfe1d1-e4c7-48b0-8197-73c7df5b82e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9780f2-f5b9-4644-afc4-0d21006385b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:08 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:08 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9780f2-f5b9-4644-afc4-0d21006385b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e6714e-7a9a-4b65-bca4-39952879577c', 'volume_name': 'volume-54e6714e-7a9a-4b65-bca4-39952879577c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180a1993-e615-4892-8de7-f072928fa2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180a1993-e615-4892-8de7-f072928fa2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05da6973-9a3e-4c1a-a081-6d0ad9e72cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Volume 54e6714e-7a9a-4b65-bca4-39952879577c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e6714e-7a9a-4b65-bca4-39952879577c', 'volume_size': 1} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478204870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e6714e-7a9a-4b65-bca4-39952879577c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5713bb6c0ad1444193acafa8b1d1dbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:08Z,use_quota=True,user_id='7d7c996c1d784f6da0e337fdd0530c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Creating volume 54e6714e-7a9a-4b65-bca4-39952879577c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (3040ce8b-649a-4a21-bf0e-bf0923f84106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e6bce9-b888-4da8-917c-25d81665c0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:08 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c 1073741824 Jul 08 01:46:08 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e6bce9-b888-4da8-917c-25d81665c0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-867647275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:09Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141fa33f-f989-4b00-bbbf-1cfd8413cef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141fa33f-f989-4b00-bbbf-1cfd8413cef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ee609f-ba89-457f-88fb-bc1262fbabfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ee609f-ba89-457f-88fb-bc1262fbabfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76', 'volume_name': 'volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ccba10-878b-49ce-adf4-912707442452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ccba10-878b-49ce-adf4-912707442452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4f6ed8-ea5a-458e-b3df-bc5ce7628639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Volume 3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76', 'volume_size': 1} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (88f6cd88-e967-41ca-b245-5eb020a197ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e868055-1cf8-4f47-90c3-955346a6eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e868055-1cf8-4f47-90c3-955346a6eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675457728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65ba2a1-bf68-4e2c-810f-7eba6e5049a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:09Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff8347b-e49e-4701-8089-f70dc2ceb8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff8347b-e49e-4701-8089-f70dc2ceb8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9865cdc-54e8-454c-8ff0-1bffa4176daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9865cdc-54e8-454c-8ff0-1bffa4176daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65ba2a1-bf68-4e2c-810f-7eba6e5049a6', 'volume_name': 'volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ad20fc-9102-4dc4-a08e-8518487cb0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ad20fc-9102-4dc4-a08e-8518487cb0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29871a9-6e8f-4352-b986-dfae1d134635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Volume b65ba2a1-bf68-4e2c-810f-7eba6e5049a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6', 'volume_size': 1} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Flow 'volume_create_manager' (1e3c0112-20cb-4a63-94f4-a62a2b6be61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c009ad-70b7-485e-8fd5-cb4d3a44e786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c009ad-70b7-485e-8fd5-cb4d3a44e786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e009143-6ccf-4060-851c-7818be437ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d906b404f8f14f718f1939b95514b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:10Z,use_quota=True,user_id='5fc6d976f89542528880c4a8237b9550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b71cb6-c283-4db8-8a73-ac4634adb5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b71cb6-c283-4db8-8a73-ac4634adb5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d36d27-23c1-4e03-bd02-72cc02640959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d36d27-23c1-4e03-bd02-72cc02640959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e009143-6ccf-4060-851c-7818be437ceb', 'volume_name': 'volume-9e009143-6ccf-4060-851c-7818be437ceb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b7c947-f7eb-4866-8db1-e4185fd2df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b7c947-f7eb-4866-8db1-e4185fd2df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae99938e-b4b9-46b9-b4bd-0d33b040d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Volume 9e009143-6ccf-4060-851c-7818be437ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e009143-6ccf-4060-851c-7818be437ceb', 'volume_size': 1} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (44a6fccd-6cca-42dc-82a4-caebf6f3a592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caeaf10-9556-418e-8bfb-abd59e0abcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caeaf10-9556-418e-8bfb-abd59e0abcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-106763003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff18a60-5e0a-4e2e-b0aa-b66568df425f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:10Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae96970e-cc3d-4db2-8dc4-9c4659aaa6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae96970e-cc3d-4db2-8dc4-9c4659aaa6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de40ac71-5419-4952-b97d-8bb7914b4ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de40ac71-5419-4952-b97d-8bb7914b4ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff18a60-5e0a-4e2e-b0aa-b66568df425f', 'volume_name': 'volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206f7b99-e251-49aa-b8cb-f751b07ca6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206f7b99-e251-49aa-b8cb-f751b07ca6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7c06c8-8044-4c48-9bc2-143b73adf7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Volume 1ff18a60-5e0a-4e2e-b0aa-b66568df425f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f', 'volume_size': 1} Jul 08 01:46:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:10 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.293s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Deleted volume successfully. Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a89637d0-0c7b-40a1-8bc5-e4bae75d7dda tempest-VolumeDependencyTests-1942376705 None] Lock "cinder-56c47a9a-8439-437e-8a9b-f6789ca4f3d5-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (1f38f0b5-28c0-4d45-ab3a-d6ab8fc14fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a72448d-7421-4ac8-b271-80f5fd18e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a72448d-7421-4ac8-b271-80f5fd18e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915955713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f6cc61-62d5-4d74-8023-f29ddbad347c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:10Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6f8e18-0874-46a1-a0e9-bccce7d74ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6f8e18-0874-46a1-a0e9-bccce7d74ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ef67ab-2731-493c-bbd6-cbaadc640e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ef67ab-2731-493c-bbd6-cbaadc640e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f6cc61-62d5-4d74-8023-f29ddbad347c', 'volume_name': 'volume-76f6cc61-62d5-4d74-8023-f29ddbad347c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e258c8-3d40-46c9-98a3-b3133fb3fdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e258c8-3d40-46c9-98a3-b3133fb3fdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4fb8e1-396d-4be8-8457-89774c5572a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Volume 76f6cc61-62d5-4d74-8023-f29ddbad347c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f6cc61-62d5-4d74-8023-f29ddbad347c', 'volume_size': 1} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:10 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c 1073741824" returned: 0 in 1.475s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:10 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c Jul 08 01:46:10 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (e10dafa3-da49-42ef-a8df-43c93d2c2b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5c8551-37db-4b9c-9411-31511aecedfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5c8551-37db-4b9c-9411-31511aecedfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1927170228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ccb35ff-3067-4a28-ad03-2f4a4a47acbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:11Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb170be-80fd-48b6-867a-fa8900c9a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb170be-80fd-48b6-867a-fa8900c9a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1ac8ae-5753-4aba-aa8f-712cae1ba77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1ac8ae-5753-4aba-aa8f-712cae1ba77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ccb35ff-3067-4a28-ad03-2f4a4a47acbe', 'volume_name': 'volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa725ada-3a74-4d61-b61e-edda7722eb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa725ada-3a74-4d61-b61e-edda7722eb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed98eda-a6c7-4625-ab5b-f377a2f59d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Volume 0ccb35ff-3067-4a28-ad03-2f4a4a47acbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe', 'volume_size': 1} Jul 08 01:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:11 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c" returned: 0 in 0.854s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-867647275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:09Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Creating volume 3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:11 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05da6973-9a3e-4c1a-a081-6d0ad9e72cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e6714e-7a9a-4b65-bca4-39952879577c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c158d8b3-eae3-4caf-be5f-ac7153b4a022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:11 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 1073741824 Jul 08 01:46:11 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:11 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Volume volume-54e6714e-7a9a-4b65-bca4-39952879577c (54e6714e-7a9a-4b65-bca4-39952879577c): created successfully Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c158d8b3-eae3-4caf-be5f-ac7153b4a022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Flow 'volume_create_manager' (db7977ba-5a3d-4e3f-a922-6685188cc2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-91e38649-fdc3-4c88-8341-789e33041f15 tempest-ProjectReaderTests-1592969503 None] Created volume successfully. Jul 08 01:46:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Acquiring lock "cinder-54e6714e-7a9a-4b65-bca4-39952879577c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Lock "cinder-54e6714e-7a9a-4b65-bca4-39952879577c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Acquiring lock "cinder-quobyte-54e6714e-7a9a-4b65-bca4-39952879577c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Lock "cinder-quobyte-54e6714e-7a9a-4b65-bca4-39952879577c" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc56686-04be-40be-8cf7-9d62c9ad8631]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:12 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 1073741824" returned: 0 in 1.018s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:12 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c Jul 08 01:46:12 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:12 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 Jul 08 01:46:12 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:12 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c" returned: 0 in 0.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:13 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c Jul 08 01:46:13 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:13 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76" returned: 0 in 0.790s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.498s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675457728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65ba2a1-bf68-4e2c-810f-7eba6e5049a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:09Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Creating volume b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:13 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4f6ed8-ea5a-458e-b3df-bc5ce7628639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:13 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 1073741824 Jul 08 01:46:13 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5994d47-d104-470f-ac51-ec8c3d1f1d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Volume volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 (3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76): created successfully Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5994d47-d104-470f-ac51-ec8c3d1f1d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (3040ce8b-649a-4a21-bf0e-bf0923f84106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-601f0628-2d2d-4128-b159-3009af97ecd9 tempest-CreateVolumesFromImageTest-947366169 None] Created volume successfully. Jul 08 01:46:13 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-54e6714e-7a9a-4b65-bca4-39952879577c" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Lock "cinder-quobyte-54e6714e-7a9a-4b65-bca4-39952879577c" released by "delete_volume" :: held 1.758s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Created reservations ['fdb27e81-6eac-4d60-b214-a032c58c3625', 'e88d2bd8-2b31-4782-913c-5a1e480b85e1', '3e70b1a5-82d5-4aa7-981e-a7a8dce67f47', '29c4a125-ae7e-4626-9c36-30c910e00f01'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:14 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:14 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:14 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (70101761-9c85-42aa-ba8f-22344e302842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223c79ab-1e84-4082-a239-98268049b1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 1073741824" returned: 0 in 1.153s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223c79ab-1e84-4082-a239-98268049b1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736457262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a17e266-2393-4811-91b4-c5241ed90521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:14Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66b1047-9a29-40d4-9df6-724a5056ae57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66b1047-9a29-40d4-9df6-724a5056ae57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b88056b-c356-43c5-bee5-83fe1bb9b347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b88056b-c356-43c5-bee5-83fe1bb9b347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a17e266-2393-4811-91b4-c5241ed90521', 'volume_name': 'volume-5a17e266-2393-4811-91b4-c5241ed90521', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1451aa54-bd6e-4930-bf33-0e4e3594de7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1451aa54-bd6e-4930-bf33-0e4e3594de7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f350cfae-ee88-4270-935b-61a88c03dca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:14 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Volume 5a17e266-2393-4811-91b4-c5241ed90521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a17e266-2393-4811-91b4-c5241ed90521', 'volume_size': 1} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:14 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 Jul 08 01:46:14 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:14 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Deleted volume successfully. Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1aefc5d4-075b-4ca5-a3e2-126afd23caf4 tempest-ProjectReaderTests-1592969503 None] Lock "cinder-54e6714e-7a9a-4b65-bca4-39952879577c-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Flow 'volume_create_manager' (dfec669c-e6ab-4f7c-9f7b-657127241ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53238749-ad54-4e5d-9ce3-bb52408d8a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53238749-ad54-4e5d-9ce3-bb52408d8a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630468117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d5ad58-1505-48a2-ae05-843f96440ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5713bb6c0ad1444193acafa8b1d1dbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:15Z,use_quota=True,user_id='7d7c996c1d784f6da0e337fdd0530c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69545a4e-1e89-4324-a950-39be6b0930b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69545a4e-1e89-4324-a950-39be6b0930b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebcb587-6dbe-4610-9bef-3693202c684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebcb587-6dbe-4610-9bef-3693202c684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d5ad58-1505-48a2-ae05-843f96440ca6', 'volume_name': 'volume-44d5ad58-1505-48a2-ae05-843f96440ca6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93b7d91-e914-462a-9600-f6f84617ebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93b7d91-e914-462a-9600-f6f84617ebba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdac1369-1376-477a-b801-5c918e01ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:15 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Volume 44d5ad58-1505-48a2-ae05-843f96440ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d5ad58-1505-48a2-ae05-843f96440ca6', 'volume_size': 1} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:15 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6" returned: 0 in 0.822s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.357s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e009143-6ccf-4060-851c-7818be437ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d906b404f8f14f718f1939b95514b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:10Z,use_quota=True,user_id='5fc6d976f89542528880c4a8237b9550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Creating volume 9e009143-6ccf-4060-851c-7818be437ceb {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:15 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:15 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb 1073741824 Jul 08 01:46:15 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29871a9-6e8f-4352-b986-dfae1d134635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ae02cd-94de-4421-bf2a-53f3e5f81b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:15 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Volume volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 (b65ba2a1-bf68-4e2c-810f-7eba6e5049a6): created successfully Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ae02cd-94de-4421-bf2a-53f3e5f81b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (88f6cd88-e967-41ca-b245-5eb020a197ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-12b06638-781b-4f21-8782-6198b0795921 tempest-CreateVolumesFromImageTest-947366169 None] Created volume successfully. Jul 08 01:46:16 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb 1073741824" returned: 0 in 0.936s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:16 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb Jul 08 01:46:16 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:16 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.928s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-106763003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff18a60-5e0a-4e2e-b0aa-b66568df425f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:10Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Creating volume 1ff18a60-5e0a-4e2e-b0aa-b66568df425f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:16 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:16 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f 1073741824 Jul 08 01:46:16 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae99938e-b4b9-46b9-b4bd-0d33b040d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e009143-6ccf-4060-851c-7818be437ceb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c58cf6-4fb0-4a64-ac99-868da10ce7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:16 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Volume volume-9e009143-6ccf-4060-851c-7818be437ceb (9e009143-6ccf-4060-851c-7818be437ceb): created successfully Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c58cf6-4fb0-4a64-ac99-868da10ce7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Flow 'volume_create_manager' (1e3c0112-20cb-4a63-94f4-a62a2b6be61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5f9845af-282f-42f1-9436-908e55e0ffe4 tempest-CinderUnicodeTest-981166110 None] Created volume successfully. Jul 08 01:46:17 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f 1073741824" returned: 0 in 0.874s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:17 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f Jul 08 01:46:17 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Flow 'volume_create_manager' (9fd54fd7-d8b7-4577-a73b-edbc96f59463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e395b74a-b8e8-4f78-912a-bf7f88fe658d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e395b74a-b8e8-4f78-912a-bf7f88fe658d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-509136065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d906b404f8f14f718f1939b95514b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:18Z,use_quota=True,user_id='5fc6d976f89542528880c4a8237b9550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f785c7e4-dd59-493c-8c40-7819e5882641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f785c7e4-dd59-493c-8c40-7819e5882641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ce210f-3c4c-4c27-8c28-ebe558a87a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ce210f-3c4c-4c27-8c28-ebe558a87a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd', 'volume_name': 'volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f20b63f-49a6-465d-a880-a802b3054fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f20b63f-49a6-465d-a880-a802b3054fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d8e64a-5717-4da2-9bad-298b66854af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Volume 2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd', 'volume_size': 1} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:18 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.356s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915955713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f6cc61-62d5-4d74-8023-f29ddbad347c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:10Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Creating volume 76f6cc61-62d5-4d74-8023-f29ddbad347c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:18 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7c06c8-8044-4c48-9bc2-143b73adf7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:18 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c 1073741824 Jul 08 01:46:18 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e124db43-7ad7-4cf2-8f34-fe1bdabacd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Volume volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f (1ff18a60-5e0a-4e2e-b0aa-b66568df425f): created successfully Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e124db43-7ad7-4cf2-8f34-fe1bdabacd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (44a6fccd-6cca-42dc-82a4-caebf6f3a592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ca329f40-ac04-4d76-ab2c-9c8b9ae78b7d tempest-CreateVolumesFromImageTest-947366169 None] Created volume successfully. Jul 08 01:46:19 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c 1073741824" returned: 0 in 0.950s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:19 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c Jul 08 01:46:19 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:20 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c" returned: 0 in 0.761s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.645s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1927170228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ccb35ff-3067-4a28-ad03-2f4a4a47acbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bbf560384440a28a91244f2cfea587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:11Z,use_quota=True,user_id='4106f4a876d142f18f62543f24ca0d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Creating volume 0ccb35ff-3067-4a28-ad03-2f4a4a47acbe {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:20 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4fb8e1-396d-4be8-8457-89774c5572a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f6cc61-62d5-4d74-8023-f29ddbad347c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6056fe8-95b6-4d80-adb6-4d252f7f0626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:20 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe 1073741824 Jul 08 01:46:20 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Volume volume-76f6cc61-62d5-4d74-8023-f29ddbad347c (76f6cc61-62d5-4d74-8023-f29ddbad347c): created successfully Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6056fe8-95b6-4d80-adb6-4d252f7f0626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (1f38f0b5-28c0-4d45-ab3a-d6ab8fc14fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c52f0efe-f05b-474c-bac6-e67416f25045 tempest-CreateVolumesFromImageTest-947366169 None] Created volume successfully. Jul 08 01:46:21 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe 1073741824" returned: 0 in 0.981s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:21 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe Jul 08 01:46:21 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:22 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe" returned: 0 in 0.693s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.773s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736457262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a17e266-2393-4811-91b4-c5241ed90521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:14Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Creating volume 5a17e266-2393-4811-91b4-c5241ed90521 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:22 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:22 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 1073741824 Jul 08 01:46:22 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed98eda-a6c7-4625-ab5b-f377a2f59d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01bd20e-9d18-46a9-aee0-ad358a5e5a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:22 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Volume volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe (0ccb35ff-3067-4a28-ad03-2f4a4a47acbe): created successfully Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01bd20e-9d18-46a9-aee0-ad358a5e5a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Flow 'volume_create_manager' (e10dafa3-da49-42ef-a8df-43c93d2c2b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-680243c2-40cf-4b2a-a53c-5880b3c577ce tempest-CreateVolumesFromImageTest-947366169 None] Created volume successfully. Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-quobyte-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[df227a94-f169-4dcd-a059-70492670ec6a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:23 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe Jul 08 01:46:23 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:23 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 1073741824" returned: 0 in 0.963s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:23 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 Jul 08 01:46:23 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:23 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe" returned: 0 in 0.886s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:23 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe Jul 08 01:46:23 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:23 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521" returned: 0 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.874s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630468117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d5ad58-1505-48a2-ae05-843f96440ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5713bb6c0ad1444193acafa8b1d1dbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:15Z,use_quota=True,user_id='7d7c996c1d784f6da0e337fdd0530c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Creating volume 44d5ad58-1505-48a2-ae05-843f96440ca6 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:23 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:23 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6 1073741824 Jul 08 01:46:23 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f350cfae-ee88-4270-935b-61a88c03dca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a17e266-2393-4811-91b4-c5241ed90521', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dab9c99-34c2-4927-9484-0b5f7edc710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Volume volume-5a17e266-2393-4811-91b4-c5241ed90521 (5a17e266-2393-4811-91b4-c5241ed90521): created successfully Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dab9c99-34c2-4927-9484-0b5f7edc710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (70101761-9c85-42aa-ba8f-22344e302842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f1b9f099-ac50-40a8-aebe-70df95787d60 tempest-ProjectReaderTests-603710565 None] Created volume successfully. Jul 08 01:46:24 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe" released by "delete_volume" :: held 1.675s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Created reservations ['bef5f1bf-f445-475e-965f-81c2e4659689', 'ce4cec21-8c98-4ce6-8fde-56828ca20354', '63251005-c7ec-483c-8460-35b04f3ef555', '50610bf4-b03d-4c70-ae66-b1028affb258'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:24 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:24 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:24 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6 1073741824" returned: 0 in 0.978s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:25 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6 Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-76f6cc61-62d5-4d74-8023-f29ddbad347c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-76f6cc61-62d5-4d74-8023-f29ddbad347c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-quobyte-76f6cc61-62d5-4d74-8023-f29ddbad347c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:25 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-76f6cc61-62d5-4d74-8023-f29ddbad347c" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdcc686-aa5d-49e9-bbbb-4e803a354567]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:25 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c Jul 08 01:46:25 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:25 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.953s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Deleted volume successfully. Jul 08 01:46:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b050dfa9-3e5c-4f2b-ba16-b1db99873cf8 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-0ccb35ff-3067-4a28-ad03-2f4a4a47acbe-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:26 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6" returned: 0 in 1.026s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.436s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-509136065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d906b404f8f14f718f1939b95514b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:18Z,use_quota=True,user_id='5fc6d976f89542528880c4a8237b9550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Creating volume 2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:26 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:26 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd 1073741824 Jul 08 01:46:26 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdac1369-1376-477a-b801-5c918e01ae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d5ad58-1505-48a2-ae05-843f96440ca6', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38db486-8290-47a6-82fb-bae946c39625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Volume volume-44d5ad58-1505-48a2-ae05-843f96440ca6 (44d5ad58-1505-48a2-ae05-843f96440ca6): created successfully Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38db486-8290-47a6-82fb-bae946c39625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Flow 'volume_create_manager' (dfec669c-e6ab-4f7c-9f7b-657127241ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e0954e1f-3997-4e17-95fb-9036b4eddfd0 tempest-ProjectReaderTests-1592969503 None] Created volume successfully. Jul 08 01:46:26 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c" returned: 0 in 1.063s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:26 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c Jul 08 01:46:26 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Acquiring lock "cinder-44d5ad58-1505-48a2-ae05-843f96440ca6-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Lock "cinder-44d5ad58-1505-48a2-ae05-843f96440ca6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Acquiring lock "cinder-quobyte-44d5ad58-1505-48a2-ae05-843f96440ca6" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Lock "cinder-quobyte-44d5ad58-1505-48a2-ae05-843f96440ca6" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c096542-8cd3-44ac-87dc-a39148f4357a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:27 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6 Jul 08 01:46:27 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:27 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd 1073741824" returned: 0 in 1.154s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:27 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd Jul 08 01:46:27 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:27 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-76f6cc61-62d5-4d74-8023-f29ddbad347c" returned: 0 in 0.922s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-76f6cc61-62d5-4d74-8023-f29ddbad347c" released by "delete_volume" :: held 2.056s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Created reservations ['d83e2f0d-f11b-4b22-bcd6-3b8ae1f84acf', '8a1dd619-81f7-4630-9c59-281eae62cbb8', 'a3eae3df-7fdb-4f97-bcee-080f57d44866', '70b915ec-7e70-45e8-b4a2-f17d268e6b4d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:27 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:27 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:27 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6" returned: 0 in 1.081s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:27 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6 Jul 08 01:46:27 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:28 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" returned: 0 in 0.923s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.928s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d8e64a-5717-4da2-9bad-298b66854af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9665b6e5-242c-4ea8-84c9-14152f19b04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Creating offline snapshot 78308c78-4609-47dc-81ee-c9c48d999a41 of volume 5a17e266-2393-4811-91b4-c5241ed90521 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Volume volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd (2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd): created successfully Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9665b6e5-242c-4ea8-84c9-14152f19b04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Flow 'volume_create_manager' (9fd54fd7-d8b7-4577-a73b-edbc96f59463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3273ebc5-ada7-4e9b-8ef2-00275db55785]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:28 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.761s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Deleted volume successfully. Jul 08 01:46:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9e0151b3-9e76-4034-8aee-49df006d7fbc tempest-CinderUnicodeTest-981166110 None] Created volume successfully. Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-851d2027-67f3-4ad5-a569-38704320ec21 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-76f6cc61-62d5-4d74-8023-f29ddbad347c-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:28 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 Jul 08 01:46:28 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-1ff18a60-5e0a-4e2e-b0aa-b66568df425f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-1ff18a60-5e0a-4e2e-b0aa-b66568df425f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-quobyte-1ff18a60-5e0a-4e2e-b0aa-b66568df425f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-1ff18a60-5e0a-4e2e-b0aa-b66568df425f" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b696d5db-cbe8-4483-a27c-9afb389bbe7e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:28 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f Jul 08 01:46:28 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:28 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-44d5ad58-1505-48a2-ae05-843f96440ca6" returned: 0 in 0.850s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Lock "cinder-quobyte-44d5ad58-1505-48a2-ae05-843f96440ca6" released by "delete_volume" :: held 1.981s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Created reservations ['66f4d83a-5361-43e5-816c-8d7d64e682c0', '59d80ad4-c844-4e4a-89c3-d29f6ed9dc23', 'bedc68df-69ed-420e-a0a6-c1ff0448869c', 'fafba47f-55a7-47e7-a5cc-5bee10a46034'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:29 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:29 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:29 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521" returned: 0 in 0.980s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:29 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 1G Jul 08 01:46:29 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:29 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f" returned: 0 in 1.283s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:29 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f Jul 08 01:46:29 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:30 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.197s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Deleted volume successfully. Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f6f4b20-3de2-45c9-977c-7d5abe1fd04a tempest-ProjectReaderTests-1592969503 None] Lock "cinder-44d5ad58-1505-48a2-ae05-843f96440ca6-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:30 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 1G" returned: 0 in 1.309s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a17e266-2393-4811-91b4-c5241ed90521 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:30 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a17e266-2393-4811-91b4-c5241ed90521 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 Jul 08 01:46:30 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:30 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1ff18a60-5e0a-4e2e-b0aa-b66568df425f" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-1ff18a60-5e0a-4e2e-b0aa-b66568df425f" released by "delete_volume" :: held 2.117s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Created reservations ['54121c16-c619-4ef2-b90e-24a4be85adc9', 'e1ebf6db-8f4f-416a-b79a-b7eb3e4f1cb6', 'c64f6a5e-063b-4e63-8488-04ba0a4a73f1', '5e8b45f5-58ad-4007-a0e0-921c65729807'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:30 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:30 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:31 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a17e266-2393-4811-91b4-c5241ed90521 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41" returned: 0 in 0.994s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:31 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 is being set with open permissions: ugo+rw Jul 08 01:46:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:31 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 Jul 08 01:46:31 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:31 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.752s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:31 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Deleted volume successfully. Jul 08 01:46:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9cec365c-ae17-496f-ba98-ba4a2ed6fdf3 tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-1ff18a60-5e0a-4e2e-b0aa-b66568df425f-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-quobyte-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[34970c72-c191-4804-ae43-4678056c9f24]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:32 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 Jul 08 01:46:32 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:32 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41" returned: 0 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:32 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.info Jul 08 01:46:32 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:33 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6" returned: 0 in 0.931s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:33 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6 Jul 08 01:46:33 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:33 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.info" returned: 0 in 0.741s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.info is being set with open permissions: ugo+rw Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:33 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.info Jul 08 01:46:33 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:33 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6" returned: 0 in 0.767s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6" released by "delete_volume" :: held 1.772s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:33 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.info" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.665s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.020s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Creating offline snapshot a861bc70-ab2f-4d97-a90a-ce4e4349997a of volume 2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e1d49d-d692-40bf-8547-80c11ef8736c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-738f5da3-4bae-404b-81aa-676fec5e6e05 tempest-ProjectReaderTests-603710565 None] Create snapshot completed successfully Jul 08 01:46:33 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Created reservations ['ace1afd5-75bf-4b6a-a665-ba8f6fcab22f', '84c230b1-25b6-4172-9ea3-140d71f0d742', '7777923e-ffaf-4091-95be-b8b523a5e3b3', '25965741-e877-4f0b-bdc5-4dc81bf0dc0f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:34 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd Jul 08 01:46:34 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:34 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:34 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "cinder-quobyte-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97a57db-0439-40b6-8868-3691dd326456]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:34 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 Jul 08 01:46:34 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:35 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.962s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Deleted volume successfully. Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f44150ca-3c39-4cd1-9864-40de5d748c1d tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-b65ba2a1-bf68-4e2c-810f-7eba6e5049a6-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:35 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" returned: 0 in 1.205s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-78308c78-4609-47dc-81ee-c9c48d999a41-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:35 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a 1G Jul 08 01:46:35 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Lock "cinder-78308c78-4609-47dc-81ee-c9c48d999a41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-5a17e266-2393-4811-91b4-c5241ed90521" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-5a17e266-2393-4811-91b4-c5241ed90521" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-78308c78-4609-47dc-81ee-c9c48d999a41" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-78308c78-4609-47dc-81ee-c9c48d999a41" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Deleting offline snapshot 78308c78-4609-47dc-81ee-c9c48d999a41 of volume 5a17e266-2393-4811-91b4-c5241ed90521 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] snapshot_file for this snap is: volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f66ff9e-22f0-4bc6-9569-5c44603ddac2]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:35 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 Jul 08 01:46:35 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:35 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76" returned: 0 in 1.242s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:35 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76 Jul 08 01:46:35 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:36 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a 1G" returned: 0 in 1.066s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:36 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a Jul 08 01:46:36 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:36 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41" returned: 0 in 0.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a17e266-2393-4811-91b4-c5241ed90521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd4b70-2560-47d7-bdde-f0f62935e385]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:36 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 Jul 08 01:46:36 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:36 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76" returned: 0 in 0.960s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-quobyte-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76" released by "delete_volume" :: held 2.279s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Created reservations ['d4f12e53-5489-4c33-8b96-da4e6572a4c1', '09fd16e1-6e89-4438-8b12-d9bb7fdafa10', '1b3cb807-44d4-4200-89f2-d17d9ec7f5ef', '42177aed-f712-44de-978f-5181bfabfc55'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:36 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:36 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:37 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a" returned: 0 in 0.914s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:37 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a is being set with open permissions: ugo+rw Jul 08 01:46:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:37 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a Jul 08 01:46:37 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:37 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521" returned: 0 in 0.986s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:37 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 Jul 08 01:46:37 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:37 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:37 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Deleted volume successfully. Jul 08 01:46:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3551fad0-1028-408e-ad5e-839b9a86356f tempest-CreateVolumesFromImageTest-947366169 None] Lock "cinder-3beb3cf9-7c0e-4e7b-8a8d-9ba84211ee76-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:37 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a" returned: 0 in 0.880s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:38 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.info Jul 08 01:46:38 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:38 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41" returned: 0 in 0.921s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:38 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41 Jul 08 01:46:38 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:38 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.info" returned: 0 in 0.907s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:38 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.info is being set with open permissions: ugo+rw Jul 08 01:46:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:38 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.info Jul 08 01:46:38 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:38 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521.78308c78-4609-47dc-81ee-c9c48d999a41" returned: 0 in 0.815s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-78308c78-4609-47dc-81ee-c9c48d999a41" released by "_delete_snapshot" :: held 3.853s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-5a17e266-2393-4811-91b4-c5241ed90521" released by "delete_snapshot" :: held 3.891s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Created reservations ['483b2313-5285-4f4e-b058-86cb9c3d68d4', '6ed74287-3e9e-4872-ab24-8f648a36da00', 'bed48b83-ee1e-474c-91f2-780ee2eadaf8', '7775a59e-c156-4654-8e9e-1b1d6c85365e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Delete snapshot completed successfully. Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b35c4d0-8c61-4bc3-8f5c-732721858267 tempest-ProjectReaderTests-603710565 None] Lock "cinder-78308c78-4609-47dc-81ee-c9c48d999a41-delete_snapshot" released by "delete_snapshot" :: held 4.090s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-5a17e266-2393-4811-91b4-c5241ed90521-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Lock "cinder-5a17e266-2393-4811-91b4-c5241ed90521-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-5a17e266-2393-4811-91b4-c5241ed90521" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-5a17e266-2393-4811-91b4-c5241ed90521" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef1c796-cdae-41b3-a04c-562a298aba12]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:39 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.info" returned: 0 in 0.918s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.020s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:39 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 Jul 08 01:46:39 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7a7f8e69-c445-487c-a086-a7f7382989ee tempest-CinderUnicodeTest-981166110 None] Create snapshot completed successfully Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Acquiring lock "cinder-a861bc70-ab2f-4d97-a90a-ce4e4349997a-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Lock "cinder-a861bc70-ab2f-4d97-a90a-ce4e4349997a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Acquiring lock "cinder-quobyte-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Lock "cinder-quobyte-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Acquiring lock "cinder-quobyte-a861bc70-ab2f-4d97-a90a-ce4e4349997a" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Lock "cinder-quobyte-a861bc70-ab2f-4d97-a90a-ce4e4349997a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Deleting offline snapshot a861bc70-ab2f-4d97-a90a-ce4e4349997a of volume 2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] snapshot_file for this snap is: volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cceb25-66bb-4978-9c99-7ffba391816d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:40 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a Jul 08 01:46:40 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:40 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521" returned: 0 in 1.080s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:40 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521 Jul 08 01:46:40 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:41 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a" returned: 0 in 1.110s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6601f8a-de05-419c-ab40-a002ef6e65ad]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:41 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-5a17e266-2393-4811-91b4-c5241ed90521" returned: 0 in 0.929s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-5a17e266-2393-4811-91b4-c5241ed90521" released by "delete_volume" :: held 2.115s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:41 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd Jul 08 01:46:41 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (58b25644-a75d-4cc0-af0f-e2d0cc9d7680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a3d542-57d3-4893-bd6d-d826e6941d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Created reservations ['2c65607b-7bd2-4209-9f13-3731918e54c4', 'ce80991f-01f5-4cc2-b984-d87a1f4cb063', 'ce6d1585-057c-40b4-884a-90f8b9cbb56e', '2fe33456-a235-42e3-b562-61371d3cfcdb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a3d542-57d3-4893-bd6d-d826e6941d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510407801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccd9d8a-90cb-421e-99f1-a5466d63ff94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:42Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d56510-5be1-4ee2-8e24-56ca8b8069d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d56510-5be1-4ee2-8e24-56ca8b8069d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9366b9e-f1fa-4e90-9ddd-43ca6ccc2b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9366b9e-f1fa-4e90-9ddd-43ca6ccc2b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccd9d8a-90cb-421e-99f1-a5466d63ff94', 'volume_name': 'volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793a164f-7cad-4d52-9676-cb52e199bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793a164f-7cad-4d52-9676-cb52e199bddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b23adbd-aea1-4a73-a7e9-b0e1bdb5cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume 9ccd9d8a-90cb-421e-99f1-a5466d63ff94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94', 'volume_size': 1} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510407801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccd9d8a-90cb-421e-99f1-a5466d63ff94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:42Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Creating volume 9ccd9d8a-90cb-421e-99f1-a5466d63ff94 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:41 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:42 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 1073741824 Jul 08 01:46:42 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:42 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:42 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:42 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" returned: 0 in 1.007s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:42 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a Jul 08 01:46:42 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:43 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.091s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Deleted volume successfully. Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1696992b-97b0-4c84-a159-88b225833c3e tempest-ProjectReaderTests-603710565 None] Lock "cinder-5a17e266-2393-4811-91b4-c5241ed90521-delete_volume" released by "delete_volume" :: held 3.710s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:43 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 1073741824" returned: 0 in 1.294s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:43 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 Jul 08 01:46:43 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (cf53f3d1-d743-4e7d-a9dd-1dcee9d079bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:43 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b281d1-95e9-4e4c-9d4a-4ba19dcd1d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a" returned: 0 in 1.225s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b281d1-95e9-4e4c-9d4a-4ba19dcd1d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-95828015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84a7bca-bd67-418c-9550-1a4788abf70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:44Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8f24d6-a95c-4a20-877b-ab30251d1f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:43 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a Jul 08 01:46:43 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8f24d6-a95c-4a20-877b-ab30251d1f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c765f9-1bf6-43c9-a6df-93dc199518d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c765f9-1bf6-43c9-a6df-93dc199518d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84a7bca-bd67-418c-9550-1a4788abf70a', 'volume_name': 'volume-b84a7bca-bd67-418c-9550-1a4788abf70a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8bb5c6-6dde-490a-b6c0-411ac571e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8bb5c6-6dde-490a-b6c0-411ac571e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce68b87f-4a5d-4c8c-904e-f0b1e49a15f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Volume b84a7bca-bd67-418c-9550-1a4788abf70a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84a7bca-bd67-418c-9550-1a4788abf70a', 'volume_size': 1} Jul 08 01:46:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:44 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" returned: 0 in 0.859s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.231s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-95828015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84a7bca-bd67-418c-9550-1a4788abf70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:44Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Creating volume b84a7bca-bd67-418c-9550-1a4788abf70a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:44 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b23adbd-aea1-4a73-a7e9-b0e1bdb5cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8462b826-674a-46a3-ba1b-6689da09eac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:44 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a 1073741824 Jul 08 01:46:44 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 (9ccd9d8a-90cb-421e-99f1-a5466d63ff94): created successfully Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8462b826-674a-46a3-ba1b-6689da09eac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (58b25644-a75d-4cc0-af0f-e2d0cc9d7680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-48d42da3-c124-472a-b2d9-ca29126c4cb5 tempest-CreateVolumesFromSnapshotTest-434284231 None] Created volume successfully. Jul 08 01:46:44 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd.a861bc70-ab2f-4d97-a90a-ce4e4349997a" returned: 0 in 0.905s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Lock "cinder-quobyte-a861bc70-ab2f-4d97-a90a-ce4e4349997a" released by "_delete_snapshot" :: held 4.387s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Lock "cinder-quobyte-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" released by "delete_snapshot" :: held 4.420s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:44 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Created reservations ['c1930394-b99d-4c52-9e8d-e23e0b613830', '940a39cb-4265-4cc5-831b-1bed2bb91841', 'c0f5fd5f-4002-4ecb-a712-ffefe5c8e953', '837844ee-25eb-4a67-b79d-155036741627'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Delete snapshot completed successfully. Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0df49a25-95ed-453f-b203-1a670505c46c tempest-CinderUnicodeTest-981166110 None] Lock "cinder-a861bc70-ab2f-4d97-a90a-ce4e4349997a-delete_snapshot" released by "delete_snapshot" :: held 4.634s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:45 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a 1073741824" returned: 0 in 1.231s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:45 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a Jul 08 01:46:45 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Acquiring lock "cinder-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Lock "cinder-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Acquiring lock "cinder-quobyte-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Lock "cinder-quobyte-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af9824-58ce-4f96-b1df-0d48da41c9b9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:46 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd Jul 08 01:46:46 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:46 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a" returned: 0 in 0.775s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.865s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce68b87f-4a5d-4c8c-904e-f0b1e49a15f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84a7bca-bd67-418c-9550-1a4788abf70a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92071c6-7dfa-4468-98d5-e3e19e92b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Creating offline snapshot c18a533e-2268-42a1-8ad5-c96ffec0db90 of volume 9ccd9d8a-90cb-421e-99f1-a5466d63ff94 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d5745-c6da-40f2-89be-b8b8ecb20cb7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Volume volume-b84a7bca-bd67-418c-9550-1a4788abf70a (b84a7bca-bd67-418c-9550-1a4788abf70a): created successfully Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92071c6-7dfa-4468-98d5-e3e19e92b934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (cf53f3d1-d743-4e7d-a9dd-1dcee9d079bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2d701302-beb1-460b-b675-98d19498730d tempest-ProjectReaderTests-603710565 None] Created volume successfully. Jul 08 01:46:46 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 Jul 08 01:46:46 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:46 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" returned: 0 in 0.914s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:46 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd Jul 08 01:46:46 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:47 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" returned: 0 in 1.036s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:47 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 1G Jul 08 01:46:47 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:47 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" returned: 0 in 0.922s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Lock "cinder-quobyte-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd" released by "delete_volume" :: held 1.908s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Created reservations ['9bb62e31-d539-4d4a-9429-8c3cf4834391', '55bfde6a-4ca1-4ceb-8228-db5068f68743', 'f7ecb977-afeb-4911-856d-4726e76574c5', '6a1df420-8362-440d-869e-08848748c35c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:47 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:47 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Acquiring lock "cinder-9e009143-6ccf-4060-851c-7818be437ceb-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Lock "cinder-9e009143-6ccf-4060-851c-7818be437ceb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:48 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Acquiring lock "cinder-quobyte-9e009143-6ccf-4060-851c-7818be437ceb" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 1G" returned: 0 in 1.015s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:48 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 Jul 08 01:46:48 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Lock "cinder-quobyte-9e009143-6ccf-4060-851c-7818be437ceb" acquired by "delete_volume" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[994551d7-8370-41fd-9bc4-86c9b9c92828]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:48 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb Jul 08 01:46:48 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:48 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.986s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Deleted volume successfully. Jul 08 01:46:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5ea62e3b-0a60-4084-a3df-ad0d7e98caa0 tempest-CinderUnicodeTest-981166110 None] Lock "cinder-2c0718d7-5d2f-4ac0-8da4-1bed3ddac0dd-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:49 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90" returned: 0 in 0.783s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:49 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 is being set with open permissions: ugo+rw Jul 08 01:46:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:49 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 Jul 08 01:46:49 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:49 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb" returned: 0 in 0.997s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:49 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb Jul 08 01:46:49 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:49 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90" returned: 0 in 0.822s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:50 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.info Jul 08 01:46:50 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:50 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9e009143-6ccf-4060-851c-7818be437ceb" returned: 0 in 0.818s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Lock "cinder-quobyte-9e009143-6ccf-4060-851c-7818be437ceb" released by "delete_volume" :: held 1.878s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Created reservations ['26141574-174d-4c27-9da1-995eada491a6', 'a552c50c-f9b3-4df7-ab2a-a3765988ecff', '11c581dc-bf19-446c-bbfe-e925d6532e4b', '9b6f43b2-eb61-4129-9e10-bda78c5d7990'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:50 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:50 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:50 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.info" returned: 0 in 0.824s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:50 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.info is being set with open permissions: ugo+rw Jul 08 01:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:50 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.info Jul 08 01:46:50 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:51 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.907s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:51 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Deleted volume successfully. Jul 08 01:46:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6c55872e-302e-4c1e-af55-016b4699a068 tempest-CinderUnicodeTest-981166110 None] Lock "cinder-9e009143-6ccf-4060-851c-7818be437ceb-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:51 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.info" returned: 0 in 0.874s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.496s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.499s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Creating offline snapshot 6616808f-6386-4495-96f6-d738e316d66f of volume b84a7bca-bd67-418c-9550-1a4788abf70a {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-da06c957-db68-41c1-9d00-b8e3341ebd99 tempest-CreateVolumesFromSnapshotTest-434284231 None] Create snapshot completed successfully Jul 08 01:46:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b073a8f2-1ac0-4b3b-a163-56ebc7271d04]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:51 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a Jul 08 01:46:51 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:52 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a" returned: 0 in 0.876s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:52 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f 1G Jul 08 01:46:52 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (0e6b325b-c2ad-4258-a1e4-887b46805ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e432f846-1399-4aaa-a659-904231cb65aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e432f846-1399-4aaa-a659-904231cb65aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203844534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8befe2b-5038-4042-9311-afb40b0a7e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:53Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa64327-85de-4a54-9a32-fa060d39d1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa64327-85de-4a54-9a32-fa060d39d1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76985213-8a00-4d54-8f95-80f4b4758b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76985213-8a00-4d54-8f95-80f4b4758b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8befe2b-5038-4042-9311-afb40b0a7e4e', 'volume_name': 'volume-b8befe2b-5038-4042-9311-afb40b0a7e4e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2277827c-38e8-43ea-8358-7cfdfcf0fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2277827c-38e8-43ea-8358-7cfdfcf0fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf7b3f4-5758-4b7c-b080-d1e58adfd6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume b8befe2b-5038-4042-9311-afb40b0a7e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8befe2b-5038-4042-9311-afb40b0a7e4e', 'volume_size': 1} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:53 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:46:53 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:53 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f 1G" returned: 0 in 1.282s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84a7bca-bd67-418c-9550-1a4788abf70a -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:54 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84a7bca-bd67-418c-9550-1a4788abf70a -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f Jul 08 01:46:54 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=144,cinder:INSERT=59,cinder:UPDATE=196,cinder:DELETE=20 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:INSERT=49,cinder:UPDATE=214,cinder:SELECT=144,cinder:DELETE=15 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (0f7a591d-facf-45b5-821a-84c2af7ce412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e314c0-9666-44ec-9cab-63027a0200d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e314c0-9666-44ec-9cab-63027a0200d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1670905746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3f2d3a-f912-4317-a7ef-7ba0c06be541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:54Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8feb2b48-dc90-4333-8592-dd3504aa5c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8feb2b48-dc90-4333-8592-dd3504aa5c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eb464d-c951-4423-a8bd-bade0c36c37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eb464d-c951-4423-a8bd-bade0c36c37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd3f2d3a-f912-4317-a7ef-7ba0c06be541', 'volume_name': 'volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87ade37-6ae3-4cae-b498-c6811fd5bc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87ade37-6ae3-4cae-b498-c6811fd5bc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5ef970-5677-4080-864b-decff0adc0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume dd3f2d3a-f912-4317-a7ef-7ba0c06be541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541', 'volume_size': 1} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:54 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 1.021s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (4519880d-e2a2-4c5a-abcf-6e483105218b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397e1da3-6d45-4a0b-9ec0-dbd1be8bf028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397e1da3-6d45-4a0b-9ec0-dbd1be8bf028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-902723234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a304f0a6-249f-42d7-80bf-b31b27d9a5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:55Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2075e890-4dd5-4d31-aa1b-eb0decb06f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2075e890-4dd5-4d31-aa1b-eb0decb06f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b200fd0e-8c1b-426e-a87a-328a615dc8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b200fd0e-8c1b-426e-a87a-328a615dc8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a304f0a6-249f-42d7-80bf-b31b27d9a5a5', 'volume_name': 'volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13938cef-8c81-4574-9a0c-a2c0098a82fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13938cef-8c81-4574-9a0c-a2c0098a82fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abe3f5c-a129-4cc0-b2a6-a58b8d51b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume a304f0a6-249f-42d7-80bf-b31b27d9a5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5', 'volume_size': 1} Jul 08 01:46:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (e727eff0-299c-45e1-b0a6-3344bddd59a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad421172-03bd-426d-9457-fa55d1d277d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad421172-03bd-426d-9457-fa55d1d277d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1438850581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0295236e-bce8-4149-8138-5738eb4f7922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:55Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07c84ff-6320-4aa4-84fe-2af20c9f6b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07c84ff-6320-4aa4-84fe-2af20c9f6b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298c5304-0242-4f01-af6b-ba7936972462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298c5304-0242-4f01-af6b-ba7936972462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0295236e-bce8-4149-8138-5738eb4f7922', 'volume_name': 'volume-0295236e-bce8-4149-8138-5738eb4f7922', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08e41f3-9a6c-4178-a017-47e11c692d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08e41f3-9a6c-4178-a017-47e11c692d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:55 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe9dc87-5cde-44f4-8a92-39cc172995c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume 0295236e-bce8-4149-8138-5738eb4f7922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0295236e-bce8-4149-8138-5738eb4f7922', 'volume_size': 1} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84a7bca-bd67-418c-9550-1a4788abf70a -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f" returned: 0 in 1.239s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:55 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f is being set with open permissions: ugo+rw Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:55 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f Jul 08 01:46:55 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87dc81bb-554d-4414-8dae-d19faefd737c tempest-ProjectAdminTests-694538632 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5856590270996, 'free_capacity_gb': 1775.5856590270996, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87204) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (3862b547-24bf-4ef8-b22d-3dda378b3414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d11fed-496f-4fdf-9308-8cd6eef554e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d11fed-496f-4fdf-9308-8cd6eef554e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973081964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d92b98-8214-4da1-aca8-900a3ce24c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:55Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26a933a-c8dd-4286-a70a-df7137477986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26a933a-c8dd-4286-a70a-df7137477986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cefb41-db08-44eb-9e73-e9360b954777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cefb41-db08-44eb-9e73-e9360b954777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d92b98-8214-4da1-aca8-900a3ce24c0c', 'volume_name': 'volume-00d92b98-8214-4da1-aca8-900a3ce24c0c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f0b285-de30-481e-b824-1b7ec6a7e516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f0b285-de30-481e-b824-1b7ec6a7e516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d9918a-986d-41b4-ac1b-769b125941fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:55 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume 00d92b98-8214-4da1-aca8-900a3ce24c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d92b98-8214-4da1-aca8-900a3ce24c0c', 'volume_size': 1} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:55 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f" returned: 0 in 0.691s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:55 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.info Jul 08 01:46:55 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:56 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.info" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:56 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.info is being set with open permissions: ugo+rw Jul 08 01:46:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:56 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.info Jul 08 01:46:56 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:57 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.info" returned: 0 in 0.815s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.757s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.033s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203844534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8befe2b-5038-4042-9311-afb40b0a7e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:53Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Creating volume b8befe2b-5038-4042-9311-afb40b0a7e4e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:57 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:57 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e 1073741824 Jul 08 01:46:57 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3268352c-23d2-4cb1-a925-7988569f49e3 tempest-ProjectReaderTests-603710565 None] Create snapshot completed successfully Jul 08 01:46:58 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e 1073741824" returned: 0 in 1.038s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:58 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e Jul 08 01:46:58 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-6616808f-6386-4495-96f6-d738e316d66f-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Lock "cinder-6616808f-6386-4495-96f6-d738e316d66f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-b84a7bca-bd67-418c-9550-1a4788abf70a" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-b84a7bca-bd67-418c-9550-1a4788abf70a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-6616808f-6386-4495-96f6-d738e316d66f" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-6616808f-6386-4495-96f6-d738e316d66f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Deleting offline snapshot 6616808f-6386-4495-96f6-d738e316d66f of volume b84a7bca-bd67-418c-9550-1a4788abf70a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] snapshot_file for this snap is: volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8997eb-49ce-44c6-a3d8-8ca4a84e5539]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:59 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f Jul 08 01:46:59 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:59 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e" returned: 0 in 0.818s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.169s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1670905746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3f2d3a-f912-4317-a7ef-7ba0c06be541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:54Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Creating volume dd3f2d3a-f912-4317-a7ef-7ba0c06be541 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf7b3f4-5758-4b7c-b080-d1e58adfd6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8befe2b-5038-4042-9311-afb40b0a7e4e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feba421-9f5d-4b75-977d-64416ee5605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:59 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 1073741824 Jul 08 01:46:59 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume volume-b8befe2b-5038-4042-9311-afb40b0a7e4e (b8befe2b-5038-4042-9311-afb40b0a7e4e): created successfully Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feba421-9f5d-4b75-977d-64416ee5605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (0e6b325b-c2ad-4258-a1e4-887b46805ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-aa2e8f89-7645-4ae0-9901-6b93702f280e tempest-CreateVolumesFromSnapshotTest-434284231 None] Created volume successfully. Jul 08 01:46:59 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f" returned: 0 in 1.011s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b84a7bca-bd67-418c-9550-1a4788abf70a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2cc634-ae2b-44a8-bdb6-cb6519f81cb6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:00 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a Jul 08 01:47:00 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:00 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 1073741824" returned: 0 in 1.028s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:00 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 Jul 08 01:47:00 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:00 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a" returned: 0 in 0.993s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:01 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f Jul 08 01:47:01 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:01 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541" returned: 0 in 0.697s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.367s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-902723234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a304f0a6-249f-42d7-80bf-b31b27d9a5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:55Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Creating volume a304f0a6-249f-42d7-80bf-b31b27d9a5a5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:01 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5ef970-5677-4080-864b-decff0adc0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 1073741824 Jul 08 01:47:01 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38274662-dffb-4765-8a22-b87bca640b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 (dd3f2d3a-f912-4317-a7ef-7ba0c06be541): created successfully Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38274662-dffb-4765-8a22-b87bca640b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (0f7a591d-facf-45b5-821a-84c2af7ce412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-09b7fbf9-360b-407c-ae8b-0e07bd1b2622 tempest-CreateVolumesFromSnapshotTest-434284231 None] Created volume successfully. Jul 08 01:47:01 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f" returned: 0 in 0.886s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:01 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f Jul 08 01:47:01 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:02 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 1073741824" returned: 0 in 0.986s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:02 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 Jul 08 01:47:02 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:02 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a.6616808f-6386-4495-96f6-d738e316d66f" returned: 0 in 0.783s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-6616808f-6386-4495-96f6-d738e316d66f" released by "_delete_snapshot" :: held 3.804s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-b84a7bca-bd67-418c-9550-1a4788abf70a" released by "delete_snapshot" :: held 3.843s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Created reservations ['05ebffbf-f8fe-407c-ba66-a24bc6d42a2a', 'e03b76e6-984a-400c-9aec-43205754a54f', '65c71858-524d-44e3-9290-61cc7f8d23e1', 'b8b0fdd7-1907-4d4b-a8c4-3a48facfdff2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Delete snapshot completed successfully. Jul 08 01:47:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e77c125c-e72c-4b75-b615-9e1c029c8423 tempest-ProjectReaderTests-603710565 None] Lock "cinder-6616808f-6386-4495-96f6-d738e316d66f-delete_snapshot" released by "delete_snapshot" :: held 4.034s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-b84a7bca-bd67-418c-9550-1a4788abf70a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:03 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5" returned: 0 in 0.843s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.901s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1438850581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0295236e-bce8-4149-8138-5738eb4f7922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:55Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Creating volume 0295236e-bce8-4149-8138-5738eb4f7922 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:03 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Lock "cinder-b84a7bca-bd67-418c-9550-1a4788abf70a-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:03 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922 1073741824 Jul 08 01:47:03 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abe3f5c-a129-4cc0-b2a6-a58b8d51b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6eb343-6ed8-46e3-8d72-597cfcb1769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 (a304f0a6-249f-42d7-80bf-b31b27d9a5a5): created successfully Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6eb343-6ed8-46e3-8d72-597cfcb1769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (4519880d-e2a2-4c5a-abcf-6e483105218b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bbdff239-b243-4020-a04c-5e1040325bd2 tempest-CreateVolumesFromSnapshotTest-434284231 None] Created volume successfully. Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-b84a7bca-bd67-418c-9550-1a4788abf70a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-b84a7bca-bd67-418c-9550-1a4788abf70a" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6b4c0a-1041-4a1f-b7b1-925622593cd8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:03 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a Jul 08 01:47:03 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:04 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922 1073741824" returned: 0 in 1.015s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:04 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922 Jul 08 01:47:04 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:04 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a" returned: 0 in 1.023s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:04 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a Jul 08 01:47:04 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:04 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.382s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973081964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d92b98-8214-4da1-aca8-900a3ce24c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d1e98fd19a4941afb52ef642b50a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:55Z,use_quota=True,user_id='830e6e8c6b5d4dc29c16e7f55b1a042c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Creating volume 00d92b98-8214-4da1-aca8-900a3ce24c0c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:04 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:05 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c 1073741824 Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe9dc87-5cde-44f4-8a92-39cc172995c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0295236e-bce8-4149-8138-5738eb4f7922', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:05 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70e28f9-3762-4d4c-a6bc-1ee148ad864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume volume-0295236e-bce8-4149-8138-5738eb4f7922 (0295236e-bce8-4149-8138-5738eb4f7922): created successfully Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70e28f9-3762-4d4c-a6bc-1ee148ad864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (e727eff0-299c-45e1-b0a6-3344bddd59a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ec30e78e-5e9e-4839-bb6c-84631981fc3e tempest-CreateVolumesFromSnapshotTest-434284231 None] Created volume successfully. Jul 08 01:47:05 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b84a7bca-bd67-418c-9550-1a4788abf70a" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-b84a7bca-bd67-418c-9550-1a4788abf70a" released by "delete_volume" :: held 1.903s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Created reservations ['4e8559df-a102-4a83-ae2c-01f281df7839', '40ba2eef-184b-4b75-b17b-a5c7f193ea72', '09e4a857-1139-4bdb-9424-08326e7ebe99', 'ae3fca38-58ed-4fca-85d3-8086a1afd1e3'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:05 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:05 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:06 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c 1073741824" returned: 0 in 1.154s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (d92afb63-0e9f-4c53-a590-b49dbd1f2c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66075c34-7bee-4782-8f72-f3bc568c05b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66075c34-7bee-4782-8f72-f3bc568c05b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130178392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0449aa2-7a0d-4344-9ad3-a512d36468ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:06Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b2a508-de73-4f23-9d7b-283172e4aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b2a508-de73-4f23-9d7b-283172e4aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b238648d-62ba-4213-a77d-a10b209b8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b238648d-62ba-4213-a77d-a10b209b8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0449aa2-7a0d-4344-9ad3-a512d36468ce', 'volume_name': 'volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634fedd9-fe69-463a-a631-d96fcbd359b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634fedd9-fe69-463a-a631-d96fcbd359b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2a0f6d-7ead-43cf-a8b0-68c597f47c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:06 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Volume e0449aa2-7a0d-4344-9ad3-a512d36468ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce', 'volume_size': 1} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:06 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.849s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Deleted volume successfully. Jul 08 01:47:06 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c Jul 08 01:47:06 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8556bd86-9428-48ac-baad-fe888481fd0f tempest-ProjectReaderTests-603710565 None] Lock "cinder-b84a7bca-bd67-418c-9550-1a4788abf70a-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (c59f877e-8dc5-4afd-b215-9ebfa2bcac8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8ba868-4384-4a1e-8fd0-d0c3cba15ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8ba868-4384-4a1e-8fd0-d0c3cba15ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178028707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b51885-bcf0-49a5-9d5e-67d0d55a22ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:07Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30db6abf-c18a-4bb1-9f5b-dbb6ed521833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30db6abf-c18a-4bb1-9f5b-dbb6ed521833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc55dc31-4838-4b5f-bf63-4c900df0918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc55dc31-4838-4b5f-bf63-4c900df0918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b51885-bcf0-49a5-9d5e-67d0d55a22ac', 'volume_name': 'volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7ae9e1-e1c1-4e96-a27e-ec1aa58b18db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7ae9e1-e1c1-4e96-a27e-ec1aa58b18db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d43f14-40cc-485d-849e-ab9a2963dab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Volume 34b51885-bcf0-49a5-9d5e-67d0d55a22ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac', 'volume_size': 1} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:07 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130178392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0449aa2-7a0d-4344-9ad3-a512d36468ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:06Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Creating volume e0449aa2-7a0d-4344-9ad3-a512d36468ce {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:07 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:07 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce 1073741824 Jul 08 01:47:07 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d9918a-986d-41b4-ac1b-769b125941fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d92b98-8214-4da1-aca8-900a3ce24c0c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648d798d-8a38-4290-ac77-6efe185120ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Volume volume-00d92b98-8214-4da1-aca8-900a3ce24c0c (00d92b98-8214-4da1-aca8-900a3ce24c0c): created successfully Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648d798d-8a38-4290-ac77-6efe185120ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Flow 'volume_create_manager' (3862b547-24bf-4ef8-b22d-3dda378b3414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4396cafe-6ff9-4153-97cd-aa477bdb7823 tempest-CreateVolumesFromSnapshotTest-434284231 None] Created volume successfully. Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-00d92b98-8214-4da1-aca8-900a3ce24c0c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-00d92b98-8214-4da1-aca8-900a3ce24c0c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-quobyte-00d92b98-8214-4da1-aca8-900a3ce24c0c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-00d92b98-8214-4da1-aca8-900a3ce24c0c" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73ab944-a4e7-4b7e-a641-f17d22d5f2b1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:07 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c Jul 08 01:47:07 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:08 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce 1073741824" returned: 0 in 0.984s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:08 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce Jul 08 01:47:08 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:08 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c" returned: 0 in 0.823s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:08 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c Jul 08 01:47:08 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:08 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce" returned: 0 in 0.675s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178028707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b51885-bcf0-49a5-9d5e-67d0d55a22ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:07Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Creating volume 34b51885-bcf0-49a5-9d5e-67d0d55a22ac {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:08 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac 1073741824 Jul 08 01:47:08 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2a0f6d-7ead-43cf-a8b0-68c597f47c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afdafa0-1b62-47d1-9c6a-9345d8d1eb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Volume volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce (e0449aa2-7a0d-4344-9ad3-a512d36468ce): created successfully Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afdafa0-1b62-47d1-9c6a-9345d8d1eb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (d92afb63-0e9f-4c53-a590-b49dbd1f2c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8ffdd66c-abd9-445a-be8b-64c043552c63 tempest-ProjectMemberTests-1781920472 None] Created volume successfully. Jul 08 01:47:09 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-00d92b98-8214-4da1-aca8-900a3ce24c0c" returned: 0 in 0.785s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-00d92b98-8214-4da1-aca8-900a3ce24c0c" released by "delete_volume" :: held 1.673s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Created reservations ['51c78e39-0ee1-4b67-91b9-527550546296', 'b0f3d982-bfd7-463e-b204-33a8402278ea', 'cab8fea2-2778-411e-9b8f-a7f1d57de351', '5eb9ae6c-01bf-4c99-bd1f-04f8bc3cb82d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:09 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:09 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:09 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac 1073741824" returned: 0 in 1.041s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-0295236e-bce8-4149-8138-5738eb4f7922-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:09 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac Jul 08 01:47:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-0295236e-bce8-4149-8138-5738eb4f7922-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:09 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-quobyte-0295236e-bce8-4149-8138-5738eb4f7922" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-0295236e-bce8-4149-8138-5738eb4f7922" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb8e6de-6fa7-42d6-abeb-1f2765499d71]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:10 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922 Jul 08 01:47:10 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:10 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Deleted volume successfully. Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7f4a7e3f-333e-49de-8184-4c56963ec74f tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-00d92b98-8214-4da1-aca8-900a3ce24c0c-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:10 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" returned: 0 in 0.698s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.857s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Creating offline snapshot d6b21615-8566-4a78-b651-2d81561eae8b of volume e0449aa2-7a0d-4344-9ad3-a512d36468ce {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d43f14-40cc-485d-849e-ab9a2963dab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae2a1fa-9ae1-4d2e-aa70-d4ce39d94780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d151e-abaa-4a87-90c7-b69dad4d0ee2]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Volume volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac (34b51885-bcf0-49a5-9d5e-67d0d55a22ac): created successfully Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae2a1fa-9ae1-4d2e-aa70-d4ce39d94780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (c59f877e-8dc5-4afd-b215-9ebfa2bcac8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-33e3dd41-eba1-4ffa-b9a8-960c4d8148b2 tempest-ProjectReaderTests-603710565 None] Created volume successfully. Jul 08 01:47:10 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce Jul 08 01:47:10 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:10 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922" returned: 0 in 0.871s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:11 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922 Jul 08 01:47:11 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:11 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce" returned: 0 in 0.902s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:11 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b 1G Jul 08 01:47:11 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:11 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-0295236e-bce8-4149-8138-5738eb4f7922" returned: 0 in 0.667s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-0295236e-bce8-4149-8138-5738eb4f7922" released by "delete_volume" :: held 1.610s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Created reservations ['605fdde7-be59-46e4-ae77-bd28d3aa7e6e', '8428ecf2-d0f5-408b-8de3-e8cf537e545a', '1dd00d19-c7e0-4b70-bad5-2abbfb96dcbd', '6e417af9-0a4e-4564-bbac-712e412e655a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:11 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:11 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-a304f0a6-249f-42d7-80bf-b31b27d9a5a5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-a304f0a6-249f-42d7-80bf-b31b27d9a5a5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-quobyte-a304f0a6-249f-42d7-80bf-b31b27d9a5a5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-a304f0a6-249f-42d7-80bf-b31b27d9a5a5" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[75171ca5-186d-4080-b844-848aee182eb4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:12 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 Jul 08 01:47:12 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:12 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b 1G" returned: 0 in 1.026s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:12 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b Jul 08 01:47:12 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:12 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Deleted volume successfully. Jul 08 01:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b512e131-bfa4-4b31-8a2b-2eb0f90c6e41 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-0295236e-bce8-4149-8138-5738eb4f7922-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:13 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5" returned: 0 in 0.969s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:13 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b" returned: 0 in 0.829s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:13 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b is being set with open permissions: ugo+rw Jul 08 01:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:13 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5 Jul 08 01:47:13 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:13 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b Jul 08 01:47:13 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:14 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a304f0a6-249f-42d7-80bf-b31b27d9a5a5" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-a304f0a6-249f-42d7-80bf-b31b27d9a5a5" released by "delete_volume" :: held 1.756s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:14 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:14 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.info Jul 08 01:47:14 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Created reservations ['d1c5db37-29d5-487a-9612-7a8f441bda50', '2b4f70e4-0476-46ee-ac5c-28bc9c3e34db', '9d4d2340-6636-4f31-a094-a67f89f0b35b', '0071843c-abf0-447d-b45e-bedbf20f21eb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:14 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:14 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-dd3f2d3a-f912-4317-a7ef-7ba0c06be541-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-dd3f2d3a-f912-4317-a7ef-7ba0c06be541-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-quobyte-dd3f2d3a-f912-4317-a7ef-7ba0c06be541" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-dd3f2d3a-f912-4317-a7ef-7ba0c06be541" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e180f42-33a3-4323-b481-d5a535593c5c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:14 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 Jul 08 01:47:14 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:15 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.info" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:15 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.info is being set with open permissions: ugo+rw Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:15 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.info Jul 08 01:47:15 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:15 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.810s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Deleted volume successfully. Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91d1d195-6b8f-4485-81fa-2fc91f0c1e47 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-a304f0a6-249f-42d7-80bf-b31b27d9a5a5-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:15 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:15 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541 Jul 08 01:47:15 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:15 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.info" returned: 0 in 0.699s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.203s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.356s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Creating offline snapshot d0ee466e-8ea7-4011-81b7-80d8e032c7e4 of volume 34b51885-bcf0-49a5-9d5e-67d0d55a22ac {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78ac4b9-487c-4d2a-bc14-5657f27fb732]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-41596320-184e-40b8-9cbe-43a4ad92705a tempest-ProjectMemberTests-1781920472 None] Create snapshot completed successfully Jul 08 01:47:16 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac Jul 08 01:47:16 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-d6b21615-8566-4a78-b651-2d81561eae8b-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-d6b21615-8566-4a78-b651-2d81561eae8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-e0449aa2-7a0d-4344-9ad3-a512d36468ce" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-e0449aa2-7a0d-4344-9ad3-a512d36468ce" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-d6b21615-8566-4a78-b651-2d81561eae8b" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-d6b21615-8566-4a78-b651-2d81561eae8b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Deleting offline snapshot d6b21615-8566-4a78-b651-2d81561eae8b of volume e0449aa2-7a0d-4344-9ad3-a512d36468ce {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] snapshot_file for this snap is: volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea9615f-2339-4f7a-91c3-bdddc6222a2c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:16 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-dd3f2d3a-f912-4317-a7ef-7ba0c06be541" returned: 0 in 0.766s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-dd3f2d3a-f912-4317-a7ef-7ba0c06be541" released by "delete_volume" :: held 1.729s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:16 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b Jul 08 01:47:16 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Created reservations ['5d2f8aba-261d-40ae-b388-7f7bbea73981', '6d9b45ec-5a37-4036-8095-dfe0d86d173e', 'f00592e4-0c87-4300-b00d-4be32eebaa68', 'a7fa7323-f5d5-4f52-a39f-3fc8326a89cf'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:16 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:16 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-b8befe2b-5038-4042-9311-afb40b0a7e4e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-b8befe2b-5038-4042-9311-afb40b0a7e4e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-quobyte-b8befe2b-5038-4042-9311-afb40b0a7e4e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-b8befe2b-5038-4042-9311-afb40b0a7e4e" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:16 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" returned: 0 in 1.110s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb45c9-986c-46a2-a3fe-d13c4107c72d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:17 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 1G Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:17 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:17 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e Jul 08 01:47:17 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:17 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b" returned: 0 in 1.107s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:17 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.866s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Deleted volume successfully. Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb1363d-bb7a-4241-bdff-3a7be4ca5e53]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c26e2a2a-b49f-4dbb-8b3b-c4a812314e3c tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-dd3f2d3a-f912-4317-a7ef-7ba0c06be541-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:17 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce Jul 08 01:47:17 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:17 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e" returned: 0 in 0.902s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:17 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 1G" returned: 0 in 0.961s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:17 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e Jul 08 01:47:17 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:17 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 Jul 08 01:47:17 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:18 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce" returned: 0 in 0.923s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:18 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b Jul 08 01:47:18 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:18 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-b8befe2b-5038-4042-9311-afb40b0a7e4e" returned: 0 in 0.733s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-b8befe2b-5038-4042-9311-afb40b0a7e4e" released by "delete_volume" :: held 1.722s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Created reservations ['eda14643-afed-4359-92ae-9bc24d697ff5', '199337d1-abf6-43e1-9582-d9fbed063fb7', '03ae3af5-43a8-48b3-b9a4-fbfa30cd44a5', '7dc08a85-a1d2-4e31-b1c3-3c17a7cde572'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:18 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4" returned: 0 in 0.836s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:18 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 is being set with open permissions: ugo+rw Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:18 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 Jul 08 01:47:18 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:18 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:18 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-c18a533e-2268-42a1-8ad5-c96ffec0db90-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-c18a533e-2268-42a1-8ad5-c96ffec0db90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-quobyte-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-quobyte-c18a533e-2268-42a1-8ad5-c96ffec0db90" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-c18a533e-2268-42a1-8ad5-c96ffec0db90" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Deleting offline snapshot c18a533e-2268-42a1-8ad5-c96ffec0db90 of volume 9ccd9d8a-90cb-421e-99f1-a5466d63ff94 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] snapshot_file for this snap is: volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:19 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b" returned: 0 in 0.919s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[41462246-9c88-4bad-a361-0a7e667b1763]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:19 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b Jul 08 01:47:19 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:19 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 Jul 08 01:47:19 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:19 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.779s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Deleted volume successfully. Jul 08 01:47:19 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4" returned: 0 in 0.889s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f873f74d-2578-4b42-9397-6e3f8dad9f07 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-b8befe2b-5038-4042-9311-afb40b0a7e4e-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:19 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.info Jul 08 01:47:19 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:20 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce.d6b21615-8566-4a78-b651-2d81561eae8b" returned: 0 in 0.830s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-d6b21615-8566-4a78-b651-2d81561eae8b" released by "_delete_snapshot" :: held 3.946s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-e0449aa2-7a0d-4344-9ad3-a512d36468ce" released by "delete_snapshot" :: held 3.978s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:20 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90" returned: 0 in 0.889s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc0f493-5455-4efa-aee1-dd11b1f615b3]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Created reservations ['ceb1ce1d-f0b9-43b6-99f3-0d5ed1ac1e10', 'd2fb8254-bd1f-4ff8-a2e5-e72176f6c99c', 'c9e3c5bb-f1bf-4799-8436-6f63416c3d4d', 'd2d91f6f-6f82-4f33-b9a1-cdeddf7ed616'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Delete snapshot completed successfully. Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-44a330e3-47c1-4215-9dfb-a135bda762a7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-d6b21615-8566-4a78-b651-2d81561eae8b-delete_snapshot" released by "delete_snapshot" :: held 4.209s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:20 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 Jul 08 01:47:20 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-e0449aa2-7a0d-4344-9ad3-a512d36468ce-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-e0449aa2-7a0d-4344-9ad3-a512d36468ce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-e0449aa2-7a0d-4344-9ad3-a512d36468ce" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-e0449aa2-7a0d-4344-9ad3-a512d36468ce" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:20 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.info" returned: 0 in 0.868s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:20 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.info is being set with open permissions: ugo+rw Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60d6ab-6b8f-40ad-b04c-95bf27dfbcb5]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:20 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.info Jul 08 01:47:20 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:20 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce Jul 08 01:47:20 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:21 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" returned: 0 in 1.063s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:21 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 Jul 08 01:47:21 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:21 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.info" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.634s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c7df0036-a788-4c62-b66d-10ac14a67fa8 tempest-ProjectReaderTests-603710565 None] Create snapshot completed successfully Jul 08 01:47:21 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce" returned: 0 in 0.904s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:21 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce Jul 08 01:47:21 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-d0ee466e-8ea7-4011-81b7-80d8e032c7e4-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Lock "cinder-d0ee466e-8ea7-4011-81b7-80d8e032c7e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-d0ee466e-8ea7-4011-81b7-80d8e032c7e4" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-d0ee466e-8ea7-4011-81b7-80d8e032c7e4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Deleting offline snapshot d0ee466e-8ea7-4011-81b7-80d8e032c7e4 of volume 34b51885-bcf0-49a5-9d5e-67d0d55a22ac {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] snapshot_file for this snap is: volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[316e6400-c3c0-4e09-8073-161c5b18f5c6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:22 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 Jul 08 01:47:22 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:22 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90" returned: 0 in 0.948s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:22 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90 Jul 08 01:47:22 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:22 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e0449aa2-7a0d-4344-9ad3-a512d36468ce" returned: 0 in 0.832s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-e0449aa2-7a0d-4344-9ad3-a512d36468ce" released by "delete_volume" :: held 1.831s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Created reservations ['222a6cb2-85fb-4dbd-a818-5dacbfa3bc72', '92fce3d8-b3b5-4e9a-9b4a-18de80528744', 'b2b7de31-e1e3-4f16-a480-d09ee8d91809', '26ff431c-be0f-4612-b56b-55c74931f75c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:22 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:22 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:23 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94.c18a533e-2268-42a1-8ad5-c96ffec0db90" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:23 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4" returned: 0 in 1.011s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-c18a533e-2268-42a1-8ad5-c96ffec0db90" released by "_delete_snapshot" :: held 3.913s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" released by "delete_snapshot" :: held 3.942s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5439d32-a156-48bc-9d0d-adbd459e39d6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Created reservations ['6a264b38-d13e-40d7-a5ee-c38a36aa0293', '080eb62d-db54-4840-aca1-25bed000b4d2', 'ab70c359-07fc-44ef-b766-1b1f9947d1fb', '0670f5bf-205a-4096-a409-6324776c336c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:23 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac Jul 08 01:47:23 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (b790aecd-28ff-479a-942c-78ba280ad30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9afeceb-0bbb-4abe-b165-3274aa3a8239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Delete snapshot completed successfully. Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9afeceb-0bbb-4abe-b165-3274aa3a8239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152976342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d29e7b8-518f-4fd0-973c-6dd9b268106b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:23Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88677167-3cda-4f33-9dd0-ab40a22564ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88677167-3cda-4f33-9dd0-ab40a22564ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc17c9da-2da2-4226-84ef-6a379654acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc17c9da-2da2-4226-84ef-6a379654acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d29e7b8-518f-4fd0-973c-6dd9b268106b', 'volume_name': 'volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a99a1d4-e892-4acf-8286-48bca0a2f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a99a1d4-e892-4acf-8286-48bca0a2f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf9cd1f-bf14-4109-ac18-a3546486c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Volume 1d29e7b8-518f-4fd0-973c-6dd9b268106b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b', 'volume_size': 1} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152976342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d29e7b8-518f-4fd0-973c-6dd9b268106b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:23Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Creating volume 1d29e7b8-518f-4fd0-973c-6dd9b268106b {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:23 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:23 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-9ccd9d8a-90cb-421e-99f1-a5466d63ff94-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13282c00-386d-4c7b-be23-e72e9ef57ba3 tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-c18a533e-2268-42a1-8ad5-c96ffec0db90-delete_snapshot" released by "delete_snapshot" :: held 4.314s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:23 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b 1073741824 Jul 08 01:47:23 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.957s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Deleted volume successfully. Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-9ccd9d8a-90cb-421e-99f1-a5466d63ff94-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9b1a489-b7aa-4443-9b50-832bf9eaeed2 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-e0449aa2-7a0d-4344-9ad3-a512d36468ce-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "cinder-quobyte-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795cd7b-23a3-46e1-907e-6e47d34688de]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:23 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 Jul 08 01:47:23 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:24 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" returned: 0 in 0.941s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:24 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 Jul 08 01:47:24 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:24 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b 1073741824" returned: 0 in 1.051s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:24 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b Jul 08 01:47:24 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:24 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" returned: 0 in 1.000s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:24 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94 Jul 08 01:47:24 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:25 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4" returned: 0 in 0.905s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:25 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4 Jul 08 01:47:25 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:25 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b" returned: 0 in 0.851s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf9cd1f-bf14-4109-ac18-a3546486c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375945f8-4d3f-40d1-bf13-94097380696e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Volume volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b (1d29e7b8-518f-4fd0-973c-6dd9b268106b): created successfully Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375945f8-4d3f-40d1-bf13-94097380696e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (b790aecd-28ff-479a-942c-78ba280ad30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-23772ab8-1f00-4acc-acad-e30b66766036 tempest-ProjectMemberTests-1781920472 None] Created volume successfully. Jul 08 01:47:25 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" returned: 0 in 0.871s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-quobyte-9ccd9d8a-90cb-421e-99f1-a5466d63ff94" released by "delete_volume" :: held 1.935s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Created reservations ['203649f9-f9b1-4946-9af4-517df3c3f87d', '032353f7-9585-432b-bc30-a7fd7338faed', 'ad65c931-dbd1-4182-a2b0-f8a4ac44af8f', '643acc34-fc2e-466b-90d7-03905ad1b2bd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:25 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:25 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:25 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac.d0ee466e-8ea7-4011-81b7-80d8e032c7e4" returned: 0 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-d0ee466e-8ea7-4011-81b7-80d8e032c7e4" released by "_delete_snapshot" :: held 3.751s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" released by "delete_snapshot" :: held 3.778s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Created reservations ['65c196be-ddce-4080-8f59-6b941553b513', '230031a3-1124-4838-af93-5524a119430d', '0492c329-82a4-4738-b065-bdf7ba0fbac4', '1e7b9000-2663-427c-a380-f8209308c94b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Delete snapshot completed successfully. Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f7e31356-55dc-45df-89b4-64d3546c07d8 tempest-ProjectReaderTests-603710565 None] Lock "cinder-d0ee466e-8ea7-4011-81b7-80d8e032c7e4-delete_snapshot" released by "delete_snapshot" :: held 3.977s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-34b51885-bcf0-49a5-9d5e-67d0d55a22ac-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Lock "cinder-34b51885-bcf0-49a5-9d5e-67d0d55a22ac-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b9025b-ab26-445e-99e4-6f9fcb85be48]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:26 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.801s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Deleted volume successfully. Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72ce3e2f-623a-42b6-8658-544a0d67506e tempest-CreateVolumesFromSnapshotTest-434284231 None] Lock "cinder-9ccd9d8a-90cb-421e-99f1-a5466d63ff94-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:26 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac Jul 08 01:47:26 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Creating offline snapshot b8699792-b439-46a2-9add-d950d427c674 of volume 1d29e7b8-518f-4fd0-973c-6dd9b268106b {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[67815ddd-5cb3-49ed-bc3a-0b3fead4f91d]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:26 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b Jul 08 01:47:26 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:27 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" returned: 0 in 1.080s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:27 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac Jul 08 01:47:27 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:27 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b" returned: 0 in 1.044s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:27 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 1G Jul 08 01:47:27 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:28 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" returned: 0 in 0.782s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-34b51885-bcf0-49a5-9d5e-67d0d55a22ac" released by "delete_volume" :: held 1.957s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Created reservations ['b1c083b0-a121-4803-aa33-821dc476cc4c', 'c18a11ee-a99d-4c75-aeb4-8b0c3c7b443c', 'ec40fa06-2d8d-48fb-8478-704ca5dde703', 'ca96dc93-a4ea-4e6c-966a-8fb5bf23281f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:28 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:28 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:28 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 1G" returned: 0 in 1.084s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:29 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 Jul 08 01:47:29 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (8fa7470f-9349-4e11-bb40-aa41813659a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d111d9d2-46e0-4600-815e-d1d918801836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d111d9d2-46e0-4600-815e-d1d918801836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779154676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3f8262-b592-4227-825e-a8b9b5c75bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:29Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afaf7e6-b047-4813-95cb-10c62b714c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afaf7e6-b047-4813-95cb-10c62b714c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1032be89-db65-4edd-ab14-636c543f8652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1032be89-db65-4edd-ab14-636c543f8652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3f8262-b592-4227-825e-a8b9b5c75bc1', 'volume_name': 'volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ae0eb1-7f41-483c-9503-6f2709079342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ae0eb1-7f41-483c-9503-6f2709079342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8e755a-df7d-48a6-87be-7b5586303b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Volume 3a3f8262-b592-4227-825e-a8b9b5c75bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1', 'volume_size': 1} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:29 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Deleted volume successfully. Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c4923d67-d705-4cb7-a23b-3fdb0a5435ef tempest-ProjectReaderTests-603710565 None] Lock "cinder-34b51885-bcf0-49a5-9d5e-67d0d55a22ac-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:29 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674" returned: 0 in 0.981s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:29 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 is being set with open permissions: ugo+rw Jul 08 01:47:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:30 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 Jul 08 01:47:30 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:30 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674" returned: 0 in 0.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:30 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.info Jul 08 01:47:30 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:31 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.info" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:31 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.info is being set with open permissions: ugo+rw Jul 08 01:47:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:31 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.info Jul 08 01:47:31 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:32 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.info" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.449s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.849s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779154676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3f8262-b592-4227-825e-a8b9b5c75bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:29Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Creating volume 3a3f8262-b592-4227-825e-a8b9b5c75bc1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:32 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-12934965-40e8-48cc-bcb5-3ec020a02b06 tempest-ProjectMemberTests-1781920472 None] Create snapshot completed successfully Jul 08 01:47:32 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 1073741824 Jul 08 01:47:32 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-b8699792-b439-46a2-9add-d950d427c674-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Lock "cinder-b8699792-b439-46a2-9add-d950d427c674-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-1d29e7b8-518f-4fd0-973c-6dd9b268106b" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-1d29e7b8-518f-4fd0-973c-6dd9b268106b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-b8699792-b439-46a2-9add-d950d427c674" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-b8699792-b439-46a2-9add-d950d427c674" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Deleting offline snapshot b8699792-b439-46a2-9add-d950d427c674 of volume 1d29e7b8-518f-4fd0-973c-6dd9b268106b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] snapshot_file for this snap is: volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f013e8-caac-4432-aa28-0e105bf3b72c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:33 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 Jul 08 01:47:33 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:33 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 1073741824" returned: 0 in 1.081s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:33 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 Jul 08 01:47:33 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:34 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674" returned: 0 in 0.849s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:34 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1" returned: 0 in 0.723s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19d2c9a-adcc-4291-bba0-a0247477b037]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8e755a-df7d-48a6-87be-7b5586303b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281fb421-afb2-46b0-9c8b-5b5b50bfc199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:34 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Volume volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 (3a3f8262-b592-4227-825e-a8b9b5c75bc1): created successfully Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281fb421-afb2-46b0-9c8b-5b5b50bfc199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (8fa7470f-9349-4e11-bb40-aa41813659a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-362f15b9-fa1c-4590-be70-1ed76d4befe8 tempest-ProjectReaderTests-603710565 None] Created volume successfully. Jul 08 01:47:34 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b Jul 08 01:47:34 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Creating offline snapshot 601344c1-abbc-4be7-aca5-2c6f530a74ef of volume 3a3f8262-b592-4227-825e-a8b9b5c75bc1 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[66add59a-bcd9-49dc-9ab1-b8dd5d6fd597]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b" returned: 0 in 0.883s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 Jul 08 01:47:35 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:35 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 Jul 08 01:47:35 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:35 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1" returned: 0 in 0.895s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef 1G Jul 08 01:47:35 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:35 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674" returned: 0 in 0.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:36 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674 Jul 08 01:47:36 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:36 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b.b8699792-b439-46a2-9add-d950d427c674" returned: 0 in 0.731s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:36 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef 1G" returned: 0 in 0.972s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-b8699792-b439-46a2-9add-d950d427c674" released by "_delete_snapshot" :: held 3.607s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-1d29e7b8-518f-4fd0-973c-6dd9b268106b" released by "delete_snapshot" :: held 3.637s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:36 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef Jul 08 01:47:36 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Created reservations ['991aa98f-713a-411f-8f1e-a66878f651cf', 'f4a84e76-f0f0-4b3f-a540-adac6a9e150d', 'f0bc6107-7536-4fb6-b705-ade6173a43b9', 'f1d41082-dc38-48d3-9623-7db628077eeb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Delete snapshot completed successfully. Jul 08 01:47:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97ad4b72-acc2-4041-93f9-1516ed95b49f tempest-ProjectMemberTests-1781920472 None] Lock "cinder-b8699792-b439-46a2-9add-d950d427c674-delete_snapshot" released by "delete_snapshot" :: held 3.852s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-1d29e7b8-518f-4fd0-973c-6dd9b268106b-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-1d29e7b8-518f-4fd0-973c-6dd9b268106b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-1d29e7b8-518f-4fd0-973c-6dd9b268106b" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-1d29e7b8-518f-4fd0-973c-6dd9b268106b" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:37 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef" returned: 0 in 0.914s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:37 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef is being set with open permissions: ugo+rw Jul 08 01:47:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ec825e-41bb-49c8-9c53-32c90e18ea81]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:37 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef Jul 08 01:47:37 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:37 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b Jul 08 01:47:37 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:38 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:38 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.info Jul 08 01:47:38 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:38 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b" returned: 0 in 0.952s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:38 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b Jul 08 01:47:38 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:39 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.info" returned: 0 in 0.725s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:39 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.info is being set with open permissions: ugo+rw Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:39 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.info Jul 08 01:47:39 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:39 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-1d29e7b8-518f-4fd0-973c-6dd9b268106b" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-1d29e7b8-518f-4fd0-973c-6dd9b268106b" released by "delete_volume" :: held 1.828s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Created reservations ['22fca701-c314-4b41-b341-4317babfd7b3', 'b36ad410-b820-4e43-997f-ef6cd796f5a4', '8a136c8a-1ead-4529-90b8-0ca9a4fdeaca', '765bb071-1311-4e9d-b9a8-f56163040124'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:39 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:39 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:40 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.info" returned: 0 in 0.800s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.296s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4bea6142-3029-4810-97cb-af60965c5d94 tempest-ProjectReaderTests-603710565 None] Create snapshot completed successfully Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (77fad9b3-c0a1-43ba-8a15-31b542873f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b6ea76-12fb-4997-a98d-71fece1156b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b6ea76-12fb-4997-a98d-71fece1156b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526703250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1214b0-f5ac-4a25-9e77-58ecac4cd57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:40Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c5aefb-ca79-42bc-a5c8-c1f220231613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c5aefb-ca79-42bc-a5c8-c1f220231613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c16427a-251d-43de-9d64-97f4b4894985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c16427a-251d-43de-9d64-97f4b4894985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1214b0-f5ac-4a25-9e77-58ecac4cd57e', 'volume_name': 'volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57c8130-3f52-4d6d-80f3-579f42b0cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57c8130-3f52-4d6d-80f3-579f42b0cb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a526f5c8-ee39-4d1c-8aab-0b0ee5787d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Volume 4b1214b0-f5ac-4a25-9e77-58ecac4cd57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e', 'volume_size': 1} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526703250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1214b0-f5ac-4a25-9e77-58ecac4cd57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:40Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Creating volume 4b1214b0-f5ac-4a25-9e77-58ecac4cd57e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:40 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:40 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Deleted volume successfully. Jul 08 01:47:40 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e 1073741824 Jul 08 01:47:40 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e3fddf56-2944-4950-9a36-044fed105420 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-1d29e7b8-518f-4fd0-973c-6dd9b268106b-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-601344c1-abbc-4be7-aca5-2c6f530a74ef-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Lock "cinder-601344c1-abbc-4be7-aca5-2c6f530a74ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-3a3f8262-b592-4227-825e-a8b9b5c75bc1" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-3a3f8262-b592-4227-825e-a8b9b5c75bc1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-601344c1-abbc-4be7-aca5-2c6f530a74ef" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-601344c1-abbc-4be7-aca5-2c6f530a74ef" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Deleting offline snapshot 601344c1-abbc-4be7-aca5-2c6f530a74ef of volume 3a3f8262-b592-4227-825e-a8b9b5c75bc1 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] snapshot_file for this snap is: volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[16923411-3992-4d93-aa7a-76d6166fc617]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:41 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef Jul 08 01:47:41 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:41 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e 1073741824" returned: 0 in 1.045s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:41 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e Jul 08 01:47:41 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:42 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee897af-59d6-43f4-a95b-fb2ea99184ca]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:42 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" returned: 0 in 0.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:42 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 Jul 08 01:47:42 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a526f5c8-ee39-4d1c-8aab-0b0ee5787d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4d03d7-0b04-4543-8bdf-70123d2c2a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:42 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Volume volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e (4b1214b0-f5ac-4a25-9e77-58ecac4cd57e): created successfully Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4d03d7-0b04-4543-8bdf-70123d2c2a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (77fad9b3-c0a1-43ba-8a15-31b542873f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-357dbe82-92c2-4255-8bc2-094d7bcbf8e8 tempest-ProjectMemberTests-1781920472 None] Created volume successfully. Jul 08 01:47:42 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:42 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef Jul 08 01:47:42 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Creating offline snapshot d1242b40-c676-4395-b1a3-36b93c9d4c74 of volume 4b1214b0-f5ac-4a25-9e77-58ecac4cd57e {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49acee4-738c-40f5-8219-836fd44a7de0]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:43 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e Jul 08 01:47:43 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:43 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef" returned: 0 in 0.996s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:43 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef Jul 08 01:47:43 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:44 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" returned: 0 in 0.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:44 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 1G Jul 08 01:47:44 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:44 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1.601344c1-abbc-4be7-aca5-2c6f530a74ef" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-601344c1-abbc-4be7-aca5-2c6f530a74ef" released by "_delete_snapshot" :: held 3.602s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-3a3f8262-b592-4227-825e-a8b9b5c75bc1" released by "delete_snapshot" :: held 3.633s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:44 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Created reservations ['5fa1b83e-4b96-435d-a7c1-02d95ee6fb5c', '229235a4-6d55-4bdf-8473-5d5a469fac76', '9e1318d5-6222-477b-8ddb-1b40260f7dd6', 'a88820fd-492a-4bdb-9756-b679e796c3cb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Delete snapshot completed successfully. Jul 08 01:47:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-183df1f9-9ec3-45b0-ac79-28af1628b3f6 tempest-ProjectReaderTests-603710565 None] Lock "cinder-601344c1-abbc-4be7-aca5-2c6f530a74ef-delete_snapshot" released by "delete_snapshot" :: held 3.804s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-3a3f8262-b592-4227-825e-a8b9b5c75bc1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Lock "cinder-3a3f8262-b592-4227-825e-a8b9b5c75bc1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-3a3f8262-b592-4227-825e-a8b9b5c75bc1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-3a3f8262-b592-4227-825e-a8b9b5c75bc1" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:45 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 1G" returned: 0 in 0.966s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5cfc3e-a9de-43fd-81c5-aee4ef999c19]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:45 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 Jul 08 01:47:45 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:45 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 Jul 08 01:47:45 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:46 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74" returned: 0 in 0.821s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:46 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 is being set with open permissions: ugo+rw Jul 08 01:47:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:46 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 Jul 08 01:47:46 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:46 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1" returned: 0 in 0.891s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:46 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1 Jul 08 01:47:46 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:47 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74" returned: 0 in 0.637s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:47 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.info Jul 08 01:47:47 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:47 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-3a3f8262-b592-4227-825e-a8b9b5c75bc1" returned: 0 in 0.698s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-3a3f8262-b592-4227-825e-a8b9b5c75bc1" released by "delete_volume" :: held 1.661s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Created reservations ['d0e84002-fb66-498b-93aa-e8e8ee61db3e', '047db304-f02a-40f4-ae33-85e0565ad18e', 'dc3de375-f9c9-46c6-a709-e0306deb94dc', '7bfa511a-26af-43ca-81c9-272c7f8c9ac5'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:47 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:47 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:47 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.info" returned: 0 in 0.673s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:47 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.info is being set with open permissions: ugo+rw Jul 08 01:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:47 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.info Jul 08 01:47:47 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:48 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.731s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Deleted volume successfully. Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16e7b74b-42ce-4400-90d4-1b9920daa688 tempest-ProjectReaderTests-603710565 None] Lock "cinder-3a3f8262-b592-4227-825e-a8b9b5c75bc1-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (cca7188f-02f0-496a-985b-7140092dc992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01ad199-0290-4819-9611-1786dc8ef4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01ad199-0290-4819-9611-1786dc8ef4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-565604944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a64595-bfc7-4746-9c32-68fdbe18201e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:48Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157fa7b8-4e6d-4c58-9632-ec772c4865dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157fa7b8-4e6d-4c58-9632-ec772c4865dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dbf5f1-0d4b-4238-abd5-faefea7c43af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dbf5f1-0d4b-4238-abd5-faefea7c43af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a64595-bfc7-4746-9c32-68fdbe18201e', 'volume_name': 'volume-19a64595-bfc7-4746-9c32-68fdbe18201e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2036759c-cd22-4016-bb5f-e867f6f31dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2036759c-cd22-4016-bb5f-e867f6f31dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1d6305-0a49-4584-a497-5589a600c751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Volume 19a64595-bfc7-4746-9c32-68fdbe18201e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a64595-bfc7-4746-9c32-68fdbe18201e', 'volume_size': 1} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:48 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.info" returned: 0 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.783s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.217s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-565604944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a64595-bfc7-4746-9c32-68fdbe18201e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af44c7e5224732953b1e4bb616fbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:48Z,use_quota=True,user_id='b6f19315d75d4853aae5b7080ece0774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Creating volume 19a64595-bfc7-4746-9c32-68fdbe18201e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:48 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:48 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e 1073741824 Jul 08 01:47:48 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-59910e16-4fc2-4d8e-a62a-e83d182b2866 tempest-ProjectMemberTests-1781920472 None] Create snapshot completed successfully Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-d1242b40-c676-4395-b1a3-36b93c9d4c74-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Lock "cinder-d1242b40-c676-4395-b1a3-36b93c9d4c74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-d1242b40-c676-4395-b1a3-36b93c9d4c74" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-d1242b40-c676-4395-b1a3-36b93c9d4c74" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Deleting offline snapshot d1242b40-c676-4395-b1a3-36b93c9d4c74 of volume 4b1214b0-f5ac-4a25-9e77-58ecac4cd57e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] snapshot_file for this snap is: volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051acc9-75d4-4cf9-bd79-47f3d9caa7df]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:49 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 Jul 08 01:47:49 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:49 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e 1073741824" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:49 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e Jul 08 01:47:49 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:49 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74" returned: 0 in 0.832s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e5d131-0bba-4be0-851a-0960b5596c6e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:50 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e Jul 08 01:47:50 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:50 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e" returned: 0 in 0.693s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1d6305-0a49-4584-a497-5589a600c751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a64595-bfc7-4746-9c32-68fdbe18201e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2789a594-2fa6-4ab2-9507-5c0056fd977e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Volume volume-19a64595-bfc7-4746-9c32-68fdbe18201e (19a64595-bfc7-4746-9c32-68fdbe18201e): created successfully Jul 08 01:47:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2789a594-2fa6-4ab2-9507-5c0056fd977e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Flow 'volume_create_manager' (cca7188f-02f0-496a-985b-7140092dc992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8ca9d3cb-9cca-49b6-925b-02ab3edf1ee6 tempest-ProjectReaderTests-603710565 None] Created volume successfully. Jul 08 01:47:50 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:50 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 Jul 08 01:47:50 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Creating offline snapshot 1f327e24-5cd0-4226-9964-47b3952ad0ea of volume 19a64595-bfc7-4746-9c32-68fdbe18201e {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b547c4-e012-439c-ba09-ca6a11407d32]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:51 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74" returned: 0 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:51 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74 Jul 08 01:47:51 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:51 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e Jul 08 01:47:51 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:52 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e.d1242b40-c676-4395-b1a3-36b93c9d4c74" returned: 0 in 0.700s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-d1242b40-c676-4395-b1a3-36b93c9d4c74" released by "_delete_snapshot" :: held 3.288s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" released by "delete_snapshot" :: held 3.313s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:52 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Created reservations ['f78c1aa6-1783-41da-b6b0-7cb39799acd4', '0917bb5b-18aa-4f34-b255-f055d9521f80', '8c4ffc6f-3f89-4cd7-b1cf-45c3f86e5139', '72038b3a-b7ad-4a5c-91d0-22ea18ac72a6'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:52 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e" returned: 0 in 0.852s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:52 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea 1G Jul 08 01:47:52 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Delete snapshot completed successfully. Jul 08 01:47:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9df16038-e7cc-4168-b739-d3877e883f7d tempest-ProjectMemberTests-1781920472 None] Lock "cinder-d1242b40-c676-4395-b1a3-36b93c9d4c74-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:53 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea 1G" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19a64595-bfc7-4746-9c32-68fdbe18201e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:53 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19a64595-bfc7-4746-9c32-68fdbe18201e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea Jul 08 01:47:53 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Lock "cinder-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[42285f4b-85a5-49f4-9870-99ec90cca934]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:53 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e Jul 08 01:47:53 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:53 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:53 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:53 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19a64595-bfc7-4746-9c32-68fdbe18201e -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea" returned: 0 in 0.762s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:54 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea is being set with open permissions: ugo+rw Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:54 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea Jul 08 01:47:54 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:54 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:54 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e Jul 08 01:47:54 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:54 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.723s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:47:54 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea" returned: 0 in 0.690s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=166,cinder:SELECT=132,cinder:INSERT=45,cinder:DELETE=17 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=124,cinder:UPDATE=172,cinder:INSERT=44,cinder:DELETE=11 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:54 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.info Jul 08 01:47:54 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:54 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" returned: 0 in 0.732s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e" released by "delete_volume" :: held 1.649s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Created reservations ['ff28794f-db86-4857-b72b-44d7b1b6199d', '451d9af9-f47a-4148-85a7-5e8df995a68e', 'b0f5f813-b56c-43b7-86c8-0fe9f8ef9b8c', 'a6e575cb-058e-4584-998c-c230218efeac'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:55 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:47:55 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:55 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.info" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:55 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.info is being set with open permissions: ugo+rw Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:55 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.info Jul 08 01:47:55 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:55 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.711s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Deleted volume successfully. Jul 08 01:47:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-281b75eb-261c-4258-9cfa-d917f5693f9b tempest-ProjectMemberTests-1781920472 None] Lock "cinder-4b1214b0-f5ac-4a25-9e77-58ecac4cd57e-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (93df651d-4e13-48ec-b817-f1834bca7896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7879ff3-e07c-4644-97f5-67228702a737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7879ff3-e07c-4644-97f5-67228702a737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014831371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488b054f-8df3-44c2-b054-b5e35fc5ea5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:56Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea9a6cb-b4d4-487a-a9f2-9ab926d1e255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea9a6cb-b4d4-487a-a9f2-9ab926d1e255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5e20e4-df96-466d-b165-a92831ba46f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5e20e4-df96-466d-b165-a92831ba46f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488b054f-8df3-44c2-b054-b5e35fc5ea5c', 'volume_name': 'volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dd2104-c411-457e-a355-b1aed7333e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dd2104-c411-457e-a355-b1aed7333e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f799cd02-dbea-4992-afdd-ee0f8584f551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Volume 488b054f-8df3-44c2-b054-b5e35fc5ea5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c', 'volume_size': 1} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:56 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.info" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.860s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014831371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488b054f-8df3-44c2-b054-b5e35fc5ea5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:56Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Creating volume 488b054f-8df3-44c2-b054-b5e35fc5ea5c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:56 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:56 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c 1073741824 Jul 08 01:47:56 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1ab42660-8043-4ced-a8dd-3048bf8a6b51 tempest-ProjectReaderTests-603710565 None] Create snapshot completed successfully Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-1f327e24-5cd0-4226-9964-47b3952ad0ea-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Lock "cinder-1f327e24-5cd0-4226-9964-47b3952ad0ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-19a64595-bfc7-4746-9c32-68fdbe18201e" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-19a64595-bfc7-4746-9c32-68fdbe18201e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-1f327e24-5cd0-4226-9964-47b3952ad0ea" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-1f327e24-5cd0-4226-9964-47b3952ad0ea" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Deleting offline snapshot 1f327e24-5cd0-4226-9964-47b3952ad0ea of volume 19a64595-bfc7-4746-9c32-68fdbe18201e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] snapshot_file for this snap is: volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9725a15f-8b4b-4d30-b1fc-8c4f31a17a31]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:57 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea Jul 08 01:47:57 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:57 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c 1073741824" returned: 0 in 0.992s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:57 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c Jul 08 01:47:57 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:57 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea" returned: 0 in 0.921s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19a64595-bfc7-4746-9c32-68fdbe18201e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a913e37-b602-4347-85b2-4198bde1a74a]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:58 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e Jul 08 01:47:58 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:58 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c" returned: 0 in 0.802s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f799cd02-dbea-4992-afdd-ee0f8584f551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d87938-681e-4627-b954-5fc0786a53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Volume volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c (488b054f-8df3-44c2-b054-b5e35fc5ea5c): created successfully Jul 08 01:47:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d87938-681e-4627-b954-5fc0786a53a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (93df651d-4e13-48ec-b817-f1834bca7896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1226241c-6eb7-4947-ae38-2990210c2faa tempest-ProjectMemberTests-1781920472 None] Created volume successfully. Jul 08 01:47:58 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e" returned: 0 in 0.907s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:58 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea Jul 08 01:47:58 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Creating offline snapshot 4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 of volume 488b054f-8df3-44c2-b054-b5e35fc5ea5c {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d59b9-4191-4177-9507-14e187c1350c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:59 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea" returned: 0 in 0.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:59 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c Jul 08 01:47:59 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:59 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea Jul 08 01:47:59 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:00 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e.1f327e24-5cd0-4226-9964-47b3952ad0ea" returned: 0 in 0.812s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:00 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c" returned: 0 in 0.970s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-1f327e24-5cd0-4226-9964-47b3952ad0ea" released by "_delete_snapshot" :: held 3.763s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:00 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 1G Jul 08 01:48:00 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-19a64595-bfc7-4746-9c32-68fdbe18201e" released by "delete_snapshot" :: held 3.807s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:00 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Created reservations ['3f86b154-88e5-40b5-a53b-6765eb0be607', '5391fadb-0857-47b0-ae14-4bb0a453ac23', '15434130-2369-4dcf-b5a8-5487bc1e2148', '1ec67478-a095-434b-951a-b85eac32afef'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Delete snapshot completed successfully. Jul 08 01:48:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c776e39a-8f95-4fb2-b219-9925ae33fc41 tempest-ProjectReaderTests-603710565 None] Lock "cinder-1f327e24-5cd0-4226-9964-47b3952ad0ea-delete_snapshot" released by "delete_snapshot" :: held 3.991s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-19a64595-bfc7-4746-9c32-68fdbe18201e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Lock "cinder-19a64595-bfc7-4746-9c32-68fdbe18201e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Acquiring lock "cinder-quobyte-19a64595-bfc7-4746-9c32-68fdbe18201e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-19a64595-bfc7-4746-9c32-68fdbe18201e" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[29641b49-c43b-45af-a953-44df0c150db4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:01 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e Jul 08 01:48:01 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:01 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 1G" returned: 0 in 1.088s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:01 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 Jul 08 01:48:01 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:02 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e" returned: 0 in 0.953s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:02 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e Jul 08 01:48:02 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:02 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81" returned: 0 in 0.853s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:02 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 is being set with open permissions: ugo+rw Jul 08 01:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:02 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 Jul 08 01:48:02 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:02 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-19a64595-bfc7-4746-9c32-68fdbe18201e" returned: 0 in 0.769s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Lock "cinder-quobyte-19a64595-bfc7-4746-9c32-68fdbe18201e" released by "delete_volume" :: held 1.795s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Created reservations ['1e03a81c-4393-4c32-8ff4-75063a22bfb6', 'b1830bca-703b-436f-bd17-46ce9190046c', 'fd59abc7-732f-49b7-a2ef-0f246b7287d3', 'd119b441-a248-4568-aaf3-cd2c29dcd481'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:03 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:48:03 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:03 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:03 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.info Jul 08 01:48:03 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:03 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.800s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Deleted volume successfully. Jul 08 01:48:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-73513184-6648-4094-9489-ca1bb2f08644 tempest-ProjectReaderTests-603710565 None] Lock "cinder-19a64595-bfc7-4746-9c32-68fdbe18201e-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:04 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.info" returned: 0 in 0.824s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:04 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.info is being set with open permissions: ugo+rw Jul 08 01:48:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:04 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.info Jul 08 01:48:04 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:05 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.info" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.444s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4fadadb2-f9ad-4407-9083-86ba0312d7ac tempest-ProjectMemberTests-1781920472 None] Create snapshot completed successfully Jul 08 01:48:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-488b054f-8df3-44c2-b054-b5e35fc5ea5c" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-488b054f-8df3-44c2-b054-b5e35fc5ea5c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Deleting offline snapshot 4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 of volume 488b054f-8df3-44c2-b054-b5e35fc5ea5c {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:48:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] snapshot_file for this snap is: volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:48:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6763b16-64b4-4f5f-a757-7fe3a0984cfe]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:06 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 Jul 08 01:48:06 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:06 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81" returned: 0 in 0.891s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:48:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[98034329-309d-42d5-98b7-8f863d419e19]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:07 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c Jul 08 01:48:07 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:07 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:07 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 Jul 08 01:48:07 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:08 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81" returned: 0 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:08 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81 Jul 08 01:48:08 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:09 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c.4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81" returned: 0 in 0.714s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81" released by "_delete_snapshot" :: held 3.354s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-488b054f-8df3-44c2-b054-b5e35fc5ea5c" released by "delete_snapshot" :: held 3.384s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Created reservations ['55cc44a2-cccd-4571-b2ac-9d6e6b97df00', '1b3e15e7-7df2-4566-a6e5-afbc0bce8527', '0b6765e8-eba8-484a-9c9f-da80939b7c69', 'a9b5a78e-e06b-4de2-97b5-b96324fd186c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Delete snapshot completed successfully. Jul 08 01:48:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a3609953-8996-4bf4-b1a1-437f110d2659 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-4b6de1dd-ddb8-45d8-ad7d-f604e8d70f81-delete_snapshot" released by "delete_snapshot" :: held 3.535s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-488b054f-8df3-44c2-b054-b5e35fc5ea5c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-488b054f-8df3-44c2-b054-b5e35fc5ea5c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-488b054f-8df3-44c2-b054-b5e35fc5ea5c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-488b054f-8df3-44c2-b054-b5e35fc5ea5c" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[afce40b7-2d9b-4331-b6aa-c81a986156a8]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:10 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c Jul 08 01:48:10 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:11 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:11 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c Jul 08 01:48:11 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:11 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-488b054f-8df3-44c2-b054-b5e35fc5ea5c" returned: 0 in 0.658s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-488b054f-8df3-44c2-b054-b5e35fc5ea5c" released by "delete_volume" :: held 1.552s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Created reservations ['a2bad7f6-05df-46f1-8b24-062ad9064872', '0f5e778f-4fab-4278-b37f-8b08718c21f5', '2e293a4c-2e8d-49a4-b99b-48250028c740', '6c141f24-06c5-45c6-8cc0-f0354f11a450'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:11 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:48:11 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:12 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:12 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Deleted volume successfully. Jul 08 01:48:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3014e551-351c-4692-8d19-bc2fef7b2953 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-488b054f-8df3-44c2-b054-b5e35fc5ea5c-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (33e539fb-33c5-4313-83c6-ff7c70fcc37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2380c8-9579-4290-bd59-3c8dffb3723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2380c8-9579-4290-bd59-3c8dffb3723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522589162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82755a71-621c-4713-aff4-6b0f44e27271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:13Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bce226-547d-4696-ab4f-5f9d68aaa5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bce226-547d-4696-ab4f-5f9d68aaa5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e2293b-d028-41fd-93a3-b46f265ea0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e2293b-d028-41fd-93a3-b46f265ea0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82755a71-621c-4713-aff4-6b0f44e27271', 'volume_name': 'volume-82755a71-621c-4713-aff4-6b0f44e27271', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69918cb0-df8e-4c05-a09b-bfcd1b6d791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69918cb0-df8e-4c05-a09b-bfcd1b6d791f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe502c8-2d31-4c77-9721-744123ac7c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Volume 82755a71-621c-4713-aff4-6b0f44e27271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82755a71-621c-4713-aff4-6b0f44e27271', 'volume_size': 1} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522589162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82755a71-621c-4713-aff4-6b0f44e27271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:13Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Creating volume 82755a71-621c-4713-aff4-6b0f44e27271 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:13 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:48:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:13 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 1073741824 Jul 08 01:48:13 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:14 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 1073741824" returned: 0 in 1.034s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:14 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 Jul 08 01:48:14 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:14 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271" returned: 0 in 0.725s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe502c8-2d31-4c77-9721-744123ac7c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82755a71-621c-4713-aff4-6b0f44e27271', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f25799d-65e6-498a-bb69-899da151debb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:14 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Volume volume-82755a71-621c-4713-aff4-6b0f44e27271 (82755a71-621c-4713-aff4-6b0f44e27271): created successfully Jul 08 01:48:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f25799d-65e6-498a-bb69-899da151debb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (33e539fb-33c5-4313-83c6-ff7c70fcc37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4d13fb96-1641-4430-aeb2-67c3a6954686 tempest-ProjectMemberTests-1781920472 None] Created volume successfully. Jul 08 01:48:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Creating offline snapshot f2ef3419-f75d-4898-bc88-264aca7b11ea of volume 82755a71-621c-4713-aff4-6b0f44e27271 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:48:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[095af92b-a1ea-4e19-85a7-2c137ac6fa8c]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:15 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 Jul 08 01:48:15 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:16 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271" returned: 0 in 0.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:16 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea 1G Jul 08 01:48:16 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:17 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea 1G" returned: 0 in 1.033s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82755a71-621c-4713-aff4-6b0f44e27271 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:17 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82755a71-621c-4713-aff4-6b0f44e27271 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea Jul 08 01:48:17 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:18 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82755a71-621c-4713-aff4-6b0f44e27271 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea" returned: 0 in 0.806s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:18 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea is being set with open permissions: ugo+rw Jul 08 01:48:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:18 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea Jul 08 01:48:18 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:18 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:19 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.info Jul 08 01:48:19 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:19 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.info" returned: 0 in 0.697s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:19 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.info is being set with open permissions: ugo+rw Jul 08 01:48:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:19 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.info Jul 08 01:48:19 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:20 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.info" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.140s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c6f612b5-fc84-4a3f-a17d-ef35a8465521 tempest-ProjectMemberTests-1781920472 None] Create snapshot completed successfully Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-f2ef3419-f75d-4898-bc88-264aca7b11ea-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-f2ef3419-f75d-4898-bc88-264aca7b11ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-82755a71-621c-4713-aff4-6b0f44e27271" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-82755a71-621c-4713-aff4-6b0f44e27271" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-f2ef3419-f75d-4898-bc88-264aca7b11ea" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-f2ef3419-f75d-4898-bc88-264aca7b11ea" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Deleting offline snapshot f2ef3419-f75d-4898-bc88-264aca7b11ea of volume 82755a71-621c-4713-aff4-6b0f44e27271 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] snapshot_file for this snap is: volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46970be-faf7-4279-ba30-ae8df0a50e4e]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:21 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea Jul 08 01:48:21 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:22 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea" returned: 0 in 1.101s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82755a71-621c-4713-aff4-6b0f44e27271(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:48:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e631e65a-98e9-41c1-bdf4-176799ab5302]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:23 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 Jul 08 01:48:23 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:23 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271" returned: 0 in 1.018s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:24 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea Jul 08 01:48:24 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:24 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea" returned: 0 in 0.893s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:24 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea Jul 08 01:48:24 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Flow 'volume_create_manager' (69102f00-e3cf-4b92-bf9b-084368af525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32a9868-a181-48a2-b0be-27cea6ba118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32a9868-a181-48a2-b0be-27cea6ba118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686444545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2112cfb0-3e66-4302-bf42-6367f278c00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdb2bbd88ab4779893b790cd3ff45cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:25Z,use_quota=True,user_id='ccee4a0eb4a640d68aac4f4b5c3c9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5135d3-e8ee-4656-a37f-d19bf0747619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5135d3-e8ee-4656-a37f-d19bf0747619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343e6fcc-4285-4b47-b329-a980b48e7b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343e6fcc-4285-4b47-b329-a980b48e7b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2112cfb0-3e66-4302-bf42-6367f278c00c', 'volume_name': 'volume-2112cfb0-3e66-4302-bf42-6367f278c00c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3bbf5b-2c02-440b-82b9-b2fb77ac0ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3bbf5b-2c02-440b-82b9-b2fb77ac0ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b3c6a3-0759-4d25-964d-fdc3962ef292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Volume 2112cfb0-3e66-4302-bf42-6367f278c00c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2112cfb0-3e66-4302-bf42-6367f278c00c', 'volume_size': 1} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686444545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2112cfb0-3e66-4302-bf42-6367f278c00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdb2bbd88ab4779893b790cd3ff45cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:25Z,use_quota=True,user_id='ccee4a0eb4a640d68aac4f4b5c3c9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Creating volume 2112cfb0-3e66-4302-bf42-6367f278c00c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:25 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:25 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c 1073741824 Jul 08 01:48:25 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:25 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271.f2ef3419-f75d-4898-bc88-264aca7b11ea" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-f2ef3419-f75d-4898-bc88-264aca7b11ea" released by "_delete_snapshot" :: held 3.913s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-82755a71-621c-4713-aff4-6b0f44e27271" released by "delete_snapshot" :: held 3.947s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Created reservations ['db520e21-38ef-45ef-86ea-1f3b35590268', 'c870a890-2c3f-4f31-9670-ff9c5c27c7d7', '2da94ce1-d836-4d3c-ad73-5716ef7c495f', 'e45c27a7-5a3f-4eb3-a859-e898db1e6d70'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Delete snapshot completed successfully. Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bf8d7a2f-eaa7-4161-b43f-254c41cd9527 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-f2ef3419-f75d-4898-bc88-264aca7b11ea-delete_snapshot" released by "delete_snapshot" :: held 4.161s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-82755a71-621c-4713-aff4-6b0f44e27271-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Lock "cinder-82755a71-621c-4713-aff4-6b0f44e27271-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-82755a71-621c-4713-aff4-6b0f44e27271" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-82755a71-621c-4713-aff4-6b0f44e27271" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[74646186-b505-4a90-b74a-5d058d83dac7]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:26 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 Jul 08 01:48:26 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:26 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c 1073741824" returned: 0 in 1.015s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:26 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c Jul 08 01:48:26 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:26 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:26 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271 Jul 08 01:48:26 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:27 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c" returned: 0 in 0.752s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b3c6a3-0759-4d25-964d-fdc3962ef292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2112cfb0-3e66-4302-bf42-6367f278c00c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71abf01f-1030-41b2-812e-eedd7c5dd66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:27 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Volume volume-2112cfb0-3e66-4302-bf42-6367f278c00c (2112cfb0-3e66-4302-bf42-6367f278c00c): created successfully Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71abf01f-1030-41b2-812e-eedd7c5dd66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Flow 'volume_create_manager' (69102f00-e3cf-4b92-bf9b-084368af525c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7fcfff8e-74d0-4f00-9db1-0746bacffbe1 tempest-ProjectReaderTests-256596193 None] Created volume successfully. Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Acquiring lock "cinder-2112cfb0-3e66-4302-bf42-6367f278c00c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Lock "cinder-2112cfb0-3e66-4302-bf42-6367f278c00c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:27 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-82755a71-621c-4713-aff4-6b0f44e27271" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-82755a71-621c-4713-aff4-6b0f44e27271" released by "delete_volume" :: held 1.669s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Acquiring lock "cinder-quobyte-2112cfb0-3e66-4302-bf42-6367f278c00c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Lock "cinder-quobyte-2112cfb0-3e66-4302-bf42-6367f278c00c" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabcf789-f3e2-485c-8c9e-fd68ca45d396]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Created reservations ['e14c58ca-af1a-4370-8b5c-e954de7ed211', '2f7e47e7-4046-4b05-92ba-b223170a5fa5', '4930bbd0-5d4d-4d53-901c-4ff82b36fcba', '9441d402-d92f-4881-a9fe-2815f01c6297'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:27 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c Jul 08 01:48:27 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:27 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:48:27 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:28 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Deleted volume successfully. Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-042a41c0-90b6-4de8-b0b0-2f9f6d21877b tempest-ProjectMemberTests-1781920472 None] Lock "cinder-82755a71-621c-4713-aff4-6b0f44e27271-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:28 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c" returned: 0 in 1.071s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:28 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c Jul 08 01:48:28 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (73623cea-2925-46d2-b67c-582da386ffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efe6b44-96bc-46a0-8d3e-cccd2f783ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efe6b44-96bc-46a0-8d3e-cccd2f783ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852303424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0a33b7-edb2-415a-b66d-729248b0e6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:29Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc72ba97-fb4a-47ea-9d5a-559ca34dd68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc72ba97-fb4a-47ea-9d5a-559ca34dd68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa398efa-c850-40bf-87a6-f1c759f016d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa398efa-c850-40bf-87a6-f1c759f016d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0a33b7-edb2-415a-b66d-729248b0e6b8', 'volume_name': 'volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66496498-6868-4709-93af-21f19a27b5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66496498-6868-4709-93af-21f19a27b5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc5b513-98d0-40eb-bd4d-03d0b90dd3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Volume cc0a33b7-edb2-415a-b66d-729248b0e6b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8', 'volume_size': 1} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852303424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0a33b7-edb2-415a-b66d-729248b0e6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:29Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Creating volume cc0a33b7-edb2-415a-b66d-729248b0e6b8 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:29 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:29 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 1073741824 Jul 08 01:48:29 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:29 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-2112cfb0-3e66-4302-bf42-6367f278c00c" returned: 0 in 0.696s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Lock "cinder-quobyte-2112cfb0-3e66-4302-bf42-6367f278c00c" released by "delete_volume" :: held 1.819s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Created reservations ['4f19adb9-fb7b-4548-b0c6-ed5b86d25180', '5ca8dbd3-3fdf-4035-a3ef-483018f2f795', '835c286b-59fb-4655-a8a7-c6311cdc60b0', '0de84e38-42fc-4624-9cc2-0420ab9b886f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:29 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:48:29 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:30 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 1073741824" returned: 0 in 1.057s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:30 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 Jul 08 01:48:30 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:30 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.766s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Deleted volume successfully. Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-54f040b6-1502-4de0-8537-0e4879ca0f6a tempest-ProjectReaderTests-256596193 None] Lock "cinder-2112cfb0-3e66-4302-bf42-6367f278c00c-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Flow 'volume_create_manager' (ab40c7b0-b522-4384-a0a9-50ba66d4f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d85489-6b7e-4f03-b1f1-273ab21200ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d85489-6b7e-4f03-b1f1-273ab21200ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983868491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32870b0-b09e-4308-81a7-e912ac35d8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdb2bbd88ab4779893b790cd3ff45cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:31Z,use_quota=True,user_id='ccee4a0eb4a640d68aac4f4b5c3c9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd772cae-4966-4a97-88ef-3ca9c46ce5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd772cae-4966-4a97-88ef-3ca9c46ce5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a4c97d-d35e-4c96-96f6-9bf8f182de10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a4c97d-d35e-4c96-96f6-9bf8f182de10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32870b0-b09e-4308-81a7-e912ac35d8f0', 'volume_name': 'volume-a32870b0-b09e-4308-81a7-e912ac35d8f0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d435138-ad6a-4290-891c-4a5f964706ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d435138-ad6a-4290-891c-4a5f964706ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6edc6c-dabf-4b17-ab16-573cb4ca6cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Volume a32870b0-b09e-4308-81a7-e912ac35d8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32870b0-b09e-4308-81a7-e912ac35d8f0', 'volume_size': 1} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:30 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8" returned: 0 in 0.796s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983868491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32870b0-b09e-4308-81a7-e912ac35d8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdb2bbd88ab4779893b790cd3ff45cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:31Z,use_quota=True,user_id='ccee4a0eb4a640d68aac4f4b5c3c9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Creating volume a32870b0-b09e-4308-81a7-e912ac35d8f0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:30 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:31 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 1073741824 Jul 08 01:48:31 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc5b513-98d0-40eb-bd4d-03d0b90dd3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150728b0-e427-4cc2-a891-452ca04467b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Volume volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 (cc0a33b7-edb2-415a-b66d-729248b0e6b8): created successfully Jul 08 01:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150728b0-e427-4cc2-a891-452ca04467b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (73623cea-2925-46d2-b67c-582da386ffdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fcf0eda3-796a-4456-b0f6-80b2f0af1cce tempest-ProjectMemberTests-1781920472 None] Created volume successfully. Jul 08 01:48:31 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 1073741824" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:31 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 Jul 08 01:48:31 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:32 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.401s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6edc6c-dabf-4b17-ab16-573cb4ca6cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32870b0-b09e-4308-81a7-e912ac35d8f0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505f6016-9b51-40ad-9601-75c95e9277cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Creating offline snapshot f179229c-e0ac-4796-95c3-4eb4097e6132 of volume cc0a33b7-edb2-415a-b66d-729248b0e6b8 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:48:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Volume volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 (a32870b0-b09e-4308-81a7-e912ac35d8f0): created successfully Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505f6016-9b51-40ad-9601-75c95e9277cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Flow 'volume_create_manager' (ab40c7b0-b522-4384-a0a9-50ba66d4f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7274a6c9-852e-406e-999e-9cf8334792a9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8f145a2f-fefe-49aa-9698-4265dcdc3412 tempest-ProjectReaderTests-256596193 None] Created volume successfully. Jul 08 01:48:32 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 Jul 08 01:48:32 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:33 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8" returned: 0 in 0.957s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:33 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 1G Jul 08 01:48:33 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Acquiring lock "cinder-a32870b0-b09e-4308-81a7-e912ac35d8f0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Lock "cinder-a32870b0-b09e-4308-81a7-e912ac35d8f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Acquiring lock "cinder-quobyte-a32870b0-b09e-4308-81a7-e912ac35d8f0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Lock "cinder-quobyte-a32870b0-b09e-4308-81a7-e912ac35d8f0" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc84a8c5-9142-4f72-8aeb-7b6ccd7af1cf]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:34 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 Jul 08 01:48:34 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:34 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 1G" returned: 0 in 0.853s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:34 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 Jul 08 01:48:34 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:34 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0" returned: 0 in 0.883s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:34 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0 Jul 08 01:48:34 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:35 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132" returned: 0 in 0.734s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:35 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 is being set with open permissions: ugo+rw Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:35 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 Jul 08 01:48:35 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:35 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-a32870b0-b09e-4308-81a7-e912ac35d8f0" returned: 0 in 0.738s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Lock "cinder-quobyte-a32870b0-b09e-4308-81a7-e912ac35d8f0" released by "delete_volume" :: held 1.678s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Created reservations ['b6d8f9fc-48df-4dcc-8b48-31b10df5e779', '22fad858-1baf-4c18-9375-f6e0006bf333', '7f59e055-6c18-4fac-80df-9260b5be6434', '751ab435-4e20-48a8-b51f-a371b6dc6ca4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:35 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:48:35 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:36 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132" returned: 0 in 0.792s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:36 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.info Jul 08 01:48:36 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:36 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Deleted volume successfully. Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b306b6b0-d088-454e-9e62-ea9124b61193 tempest-ProjectReaderTests-256596193 None] Lock "cinder-a32870b0-b09e-4308-81a7-e912ac35d8f0-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Flow 'volume_create_manager' (25c73eb5-1d06-4b56-a70b-967f01903b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e1ca37-d9b5-4145-b216-3c86b5b4ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e1ca37-d9b5-4145-b216-3c86b5b4ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957390843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bddaf8-105f-48d1-b9e1-f7108bb46363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdb2bbd88ab4779893b790cd3ff45cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:37Z,use_quota=True,user_id='ccee4a0eb4a640d68aac4f4b5c3c9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756c066f-baf4-4309-b373-b6b8c9e029e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756c066f-baf4-4309-b373-b6b8c9e029e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37e1cb8-2c5e-4365-8e35-bd30f1561d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37e1cb8-2c5e-4365-8e35-bd30f1561d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15bddaf8-105f-48d1-b9e1-f7108bb46363', 'volume_name': 'volume-15bddaf8-105f-48d1-b9e1-f7108bb46363', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1d5e76-5dcc-426c-9e26-a60b0249a1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1d5e76-5dcc-426c-9e26-a60b0249a1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d1ca08-bcce-44be-b688-2bdad13b3a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:36 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Volume 15bddaf8-105f-48d1-b9e1-f7108bb46363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15bddaf8-105f-48d1-b9e1-f7108bb46363', 'volume_size': 1} Jul 08 01:48:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:37 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.info" returned: 0 in 0.879s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:37 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.info is being set with open permissions: ugo+rw Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:37 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.info Jul 08 01:48:37 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:37 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.info" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.154s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.116s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957390843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bddaf8-105f-48d1-b9e1-f7108bb46363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdb2bbd88ab4779893b790cd3ff45cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:37Z,use_quota=True,user_id='ccee4a0eb4a640d68aac4f4b5c3c9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Creating volume 15bddaf8-105f-48d1-b9e1-f7108bb46363 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:37 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:37 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 1073741824 Jul 08 01:48:37 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4406389b-8a9a-4743-aee5-cbb27c1d501a tempest-ProjectMemberTests-1781920472 None] Create snapshot completed successfully Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-f179229c-e0ac-4796-95c3-4eb4097e6132-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Lock "cinder-f179229c-e0ac-4796-95c3-4eb4097e6132-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-cc0a33b7-edb2-415a-b66d-729248b0e6b8" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-cc0a33b7-edb2-415a-b66d-729248b0e6b8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-f179229c-e0ac-4796-95c3-4eb4097e6132" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-f179229c-e0ac-4796-95c3-4eb4097e6132" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Deleting offline snapshot f179229c-e0ac-4796-95c3-4eb4097e6132 of volume cc0a33b7-edb2-415a-b66d-729248b0e6b8 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] snapshot_file for this snap is: volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[837edc24-c38d-428a-bfc2-1ea3865d916f]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:38 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 Jul 08 01:48:38 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:38 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 1073741824" returned: 0 in 1.119s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:39 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 Jul 08 01:48:39 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:39 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132" returned: 0 in 0.847s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ddfc41-dee3-4e32-a40c-6e790e776803]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:39 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 Jul 08 01:48:39 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:39 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363" returned: 0 in 0.798s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d1ca08-bcce-44be-b688-2bdad13b3a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15bddaf8-105f-48d1-b9e1-f7108bb46363', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81aa133f-044b-4052-bdec-ad078093030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Volume volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 (15bddaf8-105f-48d1-b9e1-f7108bb46363): created successfully Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81aa133f-044b-4052-bdec-ad078093030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Flow 'volume_create_manager' (25c73eb5-1d06-4b56-a70b-967f01903b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0a557394-af0c-4fec-a14e-f7222a825658 tempest-ProjectReaderTests-256596193 None] Created volume successfully. Jul 08 01:48:40 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8" returned: 0 in 0.863s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:40 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 Jul 08 01:48:40 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Acquiring lock "cinder-15bddaf8-105f-48d1-b9e1-f7108bb46363-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Lock "cinder-15bddaf8-105f-48d1-b9e1-f7108bb46363-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Acquiring lock "cinder-quobyte-15bddaf8-105f-48d1-b9e1-f7108bb46363" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Lock "cinder-quobyte-15bddaf8-105f-48d1-b9e1-f7108bb46363" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbca331c-0a81-4bc9-b858-3384865e1f72]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:41 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 Jul 08 01:48:41 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:41 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:41 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132 Jul 08 01:48:41 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:42 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363" returned: 0 in 0.924s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:42 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8.f179229c-e0ac-4796-95c3-4eb4097e6132" returned: 0 in 0.800s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:42 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363 Jul 08 01:48:42 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-f179229c-e0ac-4796-95c3-4eb4097e6132" released by "_delete_snapshot" :: held 3.437s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-cc0a33b7-edb2-415a-b66d-729248b0e6b8" released by "delete_snapshot" :: held 3.469s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Created reservations ['f5af0a8a-0739-4ee6-b591-a40b970090cf', '35f7002a-ea38-44fa-873d-664d54130fa3', '00bb2aca-8083-4863-ad48-f37295377de7', '6fc12955-b707-4095-bea3-896ba95f552a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Delete snapshot completed successfully. Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7c584432-dd9b-43f1-9117-343f3df7484a tempest-ProjectMemberTests-1781920472 None] Lock "cinder-f179229c-e0ac-4796-95c3-4eb4097e6132-delete_snapshot" released by "delete_snapshot" :: held 3.640s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:42 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-15bddaf8-105f-48d1-b9e1-f7108bb46363" returned: 0 in 0.774s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Lock "cinder-quobyte-15bddaf8-105f-48d1-b9e1-f7108bb46363" released by "delete_volume" :: held 1.744s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-cc0a33b7-edb2-415a-b66d-729248b0e6b8-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Created reservations ['169e0eac-5831-464a-9da7-a45fa390efc4', '36bc0a9d-b466-4759-bf96-f16ef8ea1acc', '67cd4513-44fa-4d12-b89b-ebbe7e6b6bb6', 'ce07e9c9-c096-422e-95f5-0a25ffc1dbbd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-cc0a33b7-edb2-415a-b66d-729248b0e6b8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-cc0a33b7-edb2-415a-b66d-729248b0e6b8" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-cc0a33b7-edb2-415a-b66d-729248b0e6b8" acquired by "delete_volume" :: waited 0.055s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:43 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:48:43 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c484b9-c688-44af-9367-05118f137705]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:43 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 Jul 08 01:48:43 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:43 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Flow 'volume_create_manager' (b25260bb-4fa9-4d81-9c71-00da669cf42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5130f3-eeab-4e1a-b7cd-36281481b048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Deleted volume successfully. Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5130f3-eeab-4e1a-b7cd-36281481b048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107796868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6046fd-9049-4233-8cce-6e0f62f2e28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdb2bbd88ab4779893b790cd3ff45cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:44Z,use_quota=True,user_id='ccee4a0eb4a640d68aac4f4b5c3c9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcec394-aa7f-47bb-b143-9dde46c06be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcec394-aa7f-47bb-b143-9dde46c06be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259a0589-bf4d-498b-bc06-aab22f53a2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259a0589-bf4d-498b-bc06-aab22f53a2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd6046fd-9049-4233-8cce-6e0f62f2e28a', 'volume_name': 'volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add2a1f8-9224-4b30-b5d1-f4a199960c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add2a1f8-9224-4b30-b5d1-f4a199960c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575463e5-04cb-4daf-a41d-161e94f43d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Volume fd6046fd-9049-4233-8cce-6e0f62f2e28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a', 'volume_size': 1} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107796868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6046fd-9049-4233-8cce-6e0f62f2e28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdb2bbd88ab4779893b790cd3ff45cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:44Z,use_quota=True,user_id='ccee4a0eb4a640d68aac4f4b5c3c9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Creating volume fd6046fd-9049-4233-8cce-6e0f62f2e28a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:43 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cf3687c2-648e-4495-bc5f-5d0deba931b4 tempest-ProjectReaderTests-256596193 None] Lock "cinder-15bddaf8-105f-48d1-b9e1-f7108bb46363-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:43 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a 1073741824 Jul 08 01:48:43 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:44 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8" returned: 0 in 1.074s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:44 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8 Jul 08 01:48:44 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:44 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-cc0a33b7-edb2-415a-b66d-729248b0e6b8" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-cc0a33b7-edb2-415a-b66d-729248b0e6b8" released by "delete_volume" :: held 1.915s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Created reservations ['ca667e2a-f97a-4de6-832c-3c5ff43592e7', '314c9fd1-fbcb-4301-abc3-ab9073a95749', 'eec8dd67-518f-482b-bdd7-2e7428ce5c43', 'd12f80e2-abdf-423a-b543-75040ac802e7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:45 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a 1073741824" returned: 0 in 1.118s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:45 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a Jul 08 01:48:45 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:45 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:48:45 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:45 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (15a94a5d-ed28-45e8-871d-e195b419fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0959127-f08c-4bed-a08e-95f27d3916e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0959127-f08c-4bed-a08e-95f27d3916e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805934311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e41a122-b3c6-4bbd-935b-5c525269f5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:46Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7df8fc-7bb7-44aa-8e04-29ce341d4bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7df8fc-7bb7-44aa-8e04-29ce341d4bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd8380d-e550-4081-83cb-b57d1b003bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd8380d-e550-4081-83cb-b57d1b003bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e41a122-b3c6-4bbd-935b-5c525269f5b4', 'volume_name': 'volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04131844-393c-4f25-8b0f-659971c7898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04131844-393c-4f25-8b0f-659971c7898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e972e6f-efb8-416a-9612-43f5167605cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Volume 8e41a122-b3c6-4bbd-935b-5c525269f5b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4', 'volume_size': 1} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:46 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.938s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Deleted volume successfully. Jul 08 01:48:46 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-60d8ee62-0912-479e-9c6d-7856832faca2 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-cc0a33b7-edb2-415a-b66d-729248b0e6b8-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a" returned: 0 in 1.041s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805934311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e41a122-b3c6-4bbd-935b-5c525269f5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:46Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Creating volume 8e41a122-b3c6-4bbd-935b-5c525269f5b4 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:46 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:46 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 1073741824 Jul 08 01:48:46 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575463e5-04cb-4daf-a41d-161e94f43d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b997937-6f82-4f4a-8391-545b18215be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Volume volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a (fd6046fd-9049-4233-8cce-6e0f62f2e28a): created successfully Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b997937-6f82-4f4a-8391-545b18215be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Flow 'volume_create_manager' (b25260bb-4fa9-4d81-9c71-00da669cf42b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-65397b12-3549-4182-b46c-97642de92598 tempest-ProjectReaderTests-256596193 None] Created volume successfully. Jul 08 01:48:47 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 1073741824" returned: 0 in 0.915s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Acquiring lock "cinder-fd6046fd-9049-4233-8cce-6e0f62f2e28a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Lock "cinder-fd6046fd-9049-4233-8cce-6e0f62f2e28a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:47 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 Jul 08 01:48:47 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Acquiring lock "cinder-quobyte-fd6046fd-9049-4233-8cce-6e0f62f2e28a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Lock "cinder-quobyte-fd6046fd-9049-4233-8cce-6e0f62f2e28a" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83176e8-1e7b-43af-8b8f-f374d4ecccb6]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:47 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a Jul 08 01:48:47 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:47 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4" returned: 0 in 0.739s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e972e6f-efb8-416a-9612-43f5167605cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37cc2c0-97e6-4220-9557-3589c3eeea82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:47 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Volume volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 (8e41a122-b3c6-4bbd-935b-5c525269f5b4): created successfully Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37cc2c0-97e6-4220-9557-3589c3eeea82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (15a94a5d-ed28-45e8-871d-e195b419fa72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1f2b8b4f-657e-42b1-9010-e777bb354921 tempest-ProjectMemberTests-1781920472 None] Created volume successfully. Jul 08 01:48:48 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a" returned: 0 in 0.853s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:48 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a Jul 08 01:48:48 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:48 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-fd6046fd-9049-4233-8cce-6e0f62f2e28a" returned: 0 in 0.707s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Lock "cinder-quobyte-fd6046fd-9049-4233-8cce-6e0f62f2e28a" released by "delete_volume" :: held 1.606s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Created reservations ['699934bb-3e9c-4d80-ac5c-657eff7ea280', '26fac802-0f90-4ff6-aa19-96b8bbcf1582', '825e5fd8-10b5-4607-8afa-bb0344b16a9e', 'ec007342-0f6e-4423-8c62-5c654f1fa9ee'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:48 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:48:48 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Creating offline snapshot c1bbc31c-07bc-407d-9894-46e14e8615ce of volume 8e41a122-b3c6-4bbd-935b-5c525269f5b4 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:48:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eedd5e-28bd-4b1c-be9c-c5e0fc750c02]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:49 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 Jul 08 01:48:49 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:49 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.773s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Deleted volume successfully. Jul 08 01:48:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a1f36977-ba9d-4848-a81c-5762c2ff8202 tempest-ProjectReaderTests-256596193 None] Lock "cinder-fd6046fd-9049-4233-8cce-6e0f62f2e28a-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:50 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4" returned: 0 in 0.957s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:50 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce 1G Jul 08 01:48:50 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:51 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce 1G" returned: 0 in 0.967s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:51 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce Jul 08 01:48:51 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:52 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:52 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce is being set with open permissions: ugo+rw Jul 08 01:48:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:52 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce Jul 08 01:48:52 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:52 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce" returned: 0 in 0.748s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:52 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.info Jul 08 01:48:52 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:53 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.info" returned: 0 in 0.744s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:53 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.info is being set with open permissions: ugo+rw Jul 08 01:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:53 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.info Jul 08 01:48:53 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:53 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:48:53 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:54 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.info" returned: 0 in 0.819s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:54 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.164s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.788s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:48:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:48:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:48:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-537ecc3d-d9e9-4094-9ab1-bdbf9a1ad87b tempest-ProjectMemberTests-1781920472 None] Create snapshot completed successfully Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-c1bbc31c-07bc-407d-9894-46e14e8615ce-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-c1bbc31c-07bc-407d-9894-46e14e8615ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-8e41a122-b3c6-4bbd-935b-5c525269f5b4" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-8e41a122-b3c6-4bbd-935b-5c525269f5b4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-c1bbc31c-07bc-407d-9894-46e14e8615ce" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-c1bbc31c-07bc-407d-9894-46e14e8615ce" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Deleting offline snapshot c1bbc31c-07bc-407d-9894-46e14e8615ce of volume 8e41a122-b3c6-4bbd-935b-5c525269f5b4 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] snapshot_file for this snap is: volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65ccc43-3777-4b06-99c8-9f011a48ac12]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:55 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce Jul 08 01:48:55 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:56 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce" returned: 0 in 0.920s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:48:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac4fbaa-c5ec-4f83-81f1-3ece8cd92858]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:56 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 Jul 08 01:48:56 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:57 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4" returned: 0 in 0.950s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:57 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce Jul 08 01:48:57 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:58 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:58 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce Jul 08 01:48:58 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:59 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4.c1bbc31c-07bc-407d-9894-46e14e8615ce" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-c1bbc31c-07bc-407d-9894-46e14e8615ce" released by "_delete_snapshot" :: held 3.554s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-8e41a122-b3c6-4bbd-935b-5c525269f5b4" released by "delete_snapshot" :: held 3.581s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=81,cinder:INSERT=36,cinder:UPDATE=122,cinder:DELETE=11 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=99,cinder:INSERT=29,cinder:UPDATE=126,cinder:DELETE=11 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Created reservations ['12ac5a3d-2ded-488d-9646-aa9a23fde186', 'ea41b304-6402-4738-9276-d98e9132a355', 'e7a17886-c9e7-452a-b11a-427de658b037', '3f72a542-e1f5-4d0a-8c87-e3bdd6ed1724'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Delete snapshot completed successfully. Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d5ca38d6-490c-4694-8889-236afa68eab9 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-c1bbc31c-07bc-407d-9894-46e14e8615ce-delete_snapshot" released by "delete_snapshot" :: held 3.738s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-8e41a122-b3c6-4bbd-935b-5c525269f5b4-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-8e41a122-b3c6-4bbd-935b-5c525269f5b4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-8e41a122-b3c6-4bbd-935b-5c525269f5b4" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-8e41a122-b3c6-4bbd-935b-5c525269f5b4" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0889dba-0881-4f83-bc26-b5225c5cd0b1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:00 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 Jul 08 01:49:00 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:00 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4" returned: 0 in 0.879s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:00 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4 Jul 08 01:49:00 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:01 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-8e41a122-b3c6-4bbd-935b-5c525269f5b4" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-8e41a122-b3c6-4bbd-935b-5c525269f5b4" released by "delete_volume" :: held 1.693s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:01 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Created reservations ['bf1d4d26-637c-4821-a245-c3d330c966b0', 'de336153-6a30-40b2-a1d8-fc39d2a34f5e', 'd9d06441-1025-4060-a15a-5ec5c4d764eb', '090e5a05-fa66-4328-9acb-16dce38e8dc2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:01 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:49:01 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:02 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.836s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Deleted volume successfully. Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-13ebf712-b2d9-40f1-b719-28b0203209c4 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-8e41a122-b3c6-4bbd-935b-5c525269f5b4-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (8a61a855-04b3-44c7-87d2-be223684986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b077cf-af0e-4482-869e-7c62b38ce926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b077cf-af0e-4482-869e-7c62b38ce926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203703134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bee0b8-7694-47d4-bfa9-627cc82d7b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:03Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64bf187-e6aa-4e91-bff5-888accc17a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64bf187-e6aa-4e91-bff5-888accc17a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0582702-1660-461f-b767-98f095aa8872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0582702-1660-461f-b767-98f095aa8872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12bee0b8-7694-47d4-bfa9-627cc82d7b6a', 'volume_name': 'volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7bde1f-74b9-4409-8246-eb88a56edb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7bde1f-74b9-4409-8246-eb88a56edb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906fe56b-5723-4490-a753-26374e988c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Volume 12bee0b8-7694-47d4-bfa9-627cc82d7b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a', 'volume_size': 1} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203703134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bee0b8-7694-47d4-bfa9-627cc82d7b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:03Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Creating volume 12bee0b8-7694-47d4-bfa9-627cc82d7b6a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:02 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:49:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:02 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a 1073741824 Jul 08 01:49:02 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:03 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a 1073741824" returned: 0 in 0.898s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:03 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a Jul 08 01:49:03 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:04 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906fe56b-5723-4490-a753-26374e988c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa2e2c9-2a1f-42cc-9ac4-c75145cfdcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Volume volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a (12bee0b8-7694-47d4-bfa9-627cc82d7b6a): created successfully Jul 08 01:49:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa2e2c9-2a1f-42cc-9ac4-c75145cfdcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (8a61a855-04b3-44c7-87d2-be223684986c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9313c119-4b5b-47ca-b407-d8467e7c1359 tempest-ProjectMemberTests-1781920472 None] Created volume successfully. Jul 08 01:49:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Creating offline snapshot b7b6ba13-0886-45e1-a735-adf811083de5 of volume 12bee0b8-7694-47d4-bfa9-627cc82d7b6a {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:49:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3344c878-e758-48db-9fc4-5a18f0618f59]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:05 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a Jul 08 01:49:05 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:05 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" returned: 0 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:05 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 1G Jul 08 01:49:05 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:06 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 1G" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:06 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 Jul 08 01:49:06 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:07 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:07 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 is being set with open permissions: ugo+rw Jul 08 01:49:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:07 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 Jul 08 01:49:07 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:08 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5" returned: 0 in 0.762s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:08 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.info Jul 08 01:49:08 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:09 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.info" returned: 0 in 0.803s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:09 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.info is being set with open permissions: ugo+rw Jul 08 01:49:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:09 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.info Jul 08 01:49:09 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:09 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.info" returned: 0 in 0.661s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.724s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-08c2f67b-d0c8-4058-8cb5-5293c01a7e9f tempest-ProjectMemberTests-1781920472 None] Create snapshot completed successfully Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-b7b6ba13-0886-45e1-a735-adf811083de5-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-b7b6ba13-0886-45e1-a735-adf811083de5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-b7b6ba13-0886-45e1-a735-adf811083de5" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-b7b6ba13-0886-45e1-a735-adf811083de5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Deleting offline snapshot b7b6ba13-0886-45e1-a735-adf811083de5 of volume 12bee0b8-7694-47d4-bfa9-627cc82d7b6a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] snapshot_file for this snap is: volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae97a0d4-e64f-405f-8fc9-d9c841b18697]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:10 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 Jul 08 01:49:10 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:11 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5" returned: 0 in 0.810s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:49:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fc3962-9ec5-4c3e-9d8b-e66dc0eaeeeb]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:11 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a Jul 08 01:49:11 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:12 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" returned: 0 in 0.797s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:12 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 Jul 08 01:49:12 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:12 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:12 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5 Jul 08 01:49:12 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:13 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a.b7b6ba13-0886-45e1-a735-adf811083de5" returned: 0 in 0.695s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-b7b6ba13-0886-45e1-a735-adf811083de5" released by "_delete_snapshot" :: held 3.183s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" released by "delete_snapshot" :: held 3.206s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Created reservations ['28544277-0177-4f18-9210-32c8cf309673', 'c110a6f9-6dec-414f-b035-705ff42ac8bd', '9624aa5b-9a49-4333-8143-c9902836f1db', 'cbd7e717-ef03-444d-9fe0-b7c96c12bb93'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Delete snapshot completed successfully. Jul 08 01:49:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67e61c71-98b8-4464-bd13-6fdd7c4755d8 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-b7b6ba13-0886-45e1-a735-adf811083de5-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-12bee0b8-7694-47d4-bfa9-627cc82d7b6a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-12bee0b8-7694-47d4-bfa9-627cc82d7b6a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5d49ab-29f7-46a2-aa25-db0528f3267b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:14 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a Jul 08 01:49:14 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:15 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:15 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a Jul 08 01:49:15 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:16 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" returned: 0 in 0.726s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-12bee0b8-7694-47d4-bfa9-627cc82d7b6a" released by "delete_volume" :: held 1.634s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:16 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Created reservations ['60fd2e6f-8118-4e3c-900b-ca61f5f9d3fe', '16cff094-adbb-47c9-9599-2c8891b64631', 'a02183b4-014c-43fd-818f-2dcf8ad4ba90', '2506b9b5-c55e-4ec1-ad1a-ac34fee8069c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:16 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:49:16 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:17 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.871s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Deleted volume successfully. Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d9a9f85-d3c5-4133-94b9-0309ebd5c311 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-12bee0b8-7694-47d4-bfa9-627cc82d7b6a-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (15ec07cf-da5b-43b6-a37a-570baf5e6008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775895e4-f5ac-42dc-b85a-425735596df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775895e4-f5ac-42dc-b85a-425735596df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088196324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065fd704-09c7-479f-b4e1-58e886d8f652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:17Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8e79bc-3d59-4ad0-9cfb-92a3cf0e7f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8e79bc-3d59-4ad0-9cfb-92a3cf0e7f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644bc8ed-2aab-4153-b5ca-8d7ceb8d07a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644bc8ed-2aab-4153-b5ca-8d7ceb8d07a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065fd704-09c7-479f-b4e1-58e886d8f652', 'volume_name': 'volume-065fd704-09c7-479f-b4e1-58e886d8f652', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869e240d-484e-42c8-bf8e-c1b2d3c2b4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869e240d-484e-42c8-bf8e-c1b2d3c2b4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c23ab4e-64cd-46f9-905e-c0a8793bb5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Volume 065fd704-09c7-479f-b4e1-58e886d8f652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065fd704-09c7-479f-b4e1-58e886d8f652', 'volume_size': 1} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088196324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065fd704-09c7-479f-b4e1-58e886d8f652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3284299ccc4a65af1e039d9119d783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:17Z,use_quota=True,user_id='b09b1f4a8c4944c5b9a0ee4920254002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Creating volume 065fd704-09c7-479f-b4e1-58e886d8f652 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:17 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:49:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:17 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 1073741824 Jul 08 01:49:17 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:18 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 1073741824" returned: 0 in 0.952s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:18 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 Jul 08 01:49:18 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:19 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652" returned: 0 in 0.726s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c23ab4e-64cd-46f9-905e-c0a8793bb5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065fd704-09c7-479f-b4e1-58e886d8f652', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5a1b0f-5ae0-4799-9119-53d505739311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Volume volume-065fd704-09c7-479f-b4e1-58e886d8f652 (065fd704-09c7-479f-b4e1-58e886d8f652): created successfully Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5a1b0f-5ae0-4799-9119-53d505739311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Flow 'volume_create_manager' (15ec07cf-da5b-43b6-a37a-570baf5e6008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-414ab582-fa44-42a0-ba45-b6c9394c64fb tempest-ProjectMemberTests-1781920472 None] Created volume successfully. Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Creating offline snapshot 08356c11-17d3-4535-9771-3ef6f6a09af0 of volume 065fd704-09c7-479f-b4e1-58e886d8f652 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf0460-751a-4dfd-bd91-01e2c98e5e24]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:19 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 Jul 08 01:49:19 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:20 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652" returned: 0 in 0.802s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:20 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 1G Jul 08 01:49:20 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:21 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 1G" returned: 0 in 0.972s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065fd704-09c7-479f-b4e1-58e886d8f652 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:21 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065fd704-09c7-479f-b4e1-58e886d8f652 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 Jul 08 01:49:21 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:22 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065fd704-09c7-479f-b4e1-58e886d8f652 -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0" returned: 0 in 0.750s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:22 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 is being set with open permissions: ugo+rw Jul 08 01:49:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:22 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 Jul 08 01:49:22 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:23 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0" returned: 0 in 0.769s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:23 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.info Jul 08 01:49:23 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:23 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.info" returned: 0 in 0.710s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:23 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.info is being set with open permissions: ugo+rw Jul 08 01:49:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:23 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.info Jul 08 01:49:23 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:24 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.info" returned: 0 in 0.753s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.843s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8d5e6c8b-f603-4b56-96ed-89b8b32ede42 tempest-ProjectMemberTests-1781920472 None] Create snapshot completed successfully Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-08356c11-17d3-4535-9771-3ef6f6a09af0-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-08356c11-17d3-4535-9771-3ef6f6a09af0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-065fd704-09c7-479f-b4e1-58e886d8f652" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-065fd704-09c7-479f-b4e1-58e886d8f652" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-08356c11-17d3-4535-9771-3ef6f6a09af0" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-08356c11-17d3-4535-9771-3ef6f6a09af0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Deleting offline snapshot 08356c11-17d3-4535-9771-3ef6f6a09af0 of volume 065fd704-09c7-479f-b4e1-58e886d8f652 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] snapshot_file for this snap is: volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80dc781-0a1c-400f-b3fc-f96a07b1dc14]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:25 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 Jul 08 01:49:25 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:25 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0" returned: 0 in 0.813s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-065fd704-09c7-479f-b4e1-58e886d8f652(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a43cd7f-e29e-47b2-b1f4-7596b52a89af]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:26 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 Jul 08 01:49:26 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:26 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652" returned: 0 in 0.839s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:26 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 Jul 08 01:49:26 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:27 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0" returned: 0 in 0.883s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:27 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0 Jul 08 01:49:27 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:28 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652.08356c11-17d3-4535-9771-3ef6f6a09af0" returned: 0 in 0.675s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-08356c11-17d3-4535-9771-3ef6f6a09af0" released by "_delete_snapshot" :: held 3.315s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-065fd704-09c7-479f-b4e1-58e886d8f652" released by "delete_snapshot" :: held 3.337s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Created reservations ['80ccd97b-be72-4205-8d70-f4d975a85e4c', '6cc1a191-2dac-4b74-a507-6699457bc195', '217c4c6d-574f-46a2-a580-29f50adf86cd', 'ac54cab1-09f6-417d-8385-368ab215f493'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Delete snapshot completed successfully. Jul 08 01:49:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a2bd2e08-5252-4e46-988a-4d3ccae5eba7 tempest-ProjectMemberTests-1781920472 None] Lock "cinder-08356c11-17d3-4535-9771-3ef6f6a09af0-delete_snapshot" released by "delete_snapshot" :: held 3.479s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-065fd704-09c7-479f-b4e1-58e886d8f652-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Lock "cinder-065fd704-09c7-479f-b4e1-58e886d8f652-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Acquiring lock "cinder-quobyte-065fd704-09c7-479f-b4e1-58e886d8f652" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-065fd704-09c7-479f-b4e1-58e886d8f652" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8a83c9-36f5-4616-8c46-6a27920c0760]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:29 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 Jul 08 01:49:29 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:30 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652" returned: 0 in 0.881s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:30 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652 Jul 08 01:49:30 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:31 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-065fd704-09c7-479f-b4e1-58e886d8f652" returned: 0 in 0.753s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Lock "cinder-quobyte-065fd704-09c7-479f-b4e1-58e886d8f652" released by "delete_volume" :: held 1.695s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:31 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Created reservations ['9bdea18a-61ec-4815-b33f-30d42b43ef95', '7f4b4a28-a551-46af-80b6-f5d4f0c96c17', 'ee2e25ce-78ff-4e37-9b77-cc4d03e57c56', 'e816353f-2f73-4e64-bdca-2e454e754e3e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:31 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:49:31 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:32 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:32 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Deleted volume successfully. Jul 08 01:49:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac11b06e-a6e0-4547-a37e-1fb3e53dc8cb tempest-ProjectMemberTests-1781920472 None] Lock "cinder-065fd704-09c7-479f-b4e1-58e886d8f652-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:41 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=45,cinder:INSERT=15,cinder:UPDATE=47 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:49:42 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:INSERT=13,cinder:UPDATE=53,cinder:SELECT=29,cinder:DELETE=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:49:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:49:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:53 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:49:53 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:54 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.706s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:49:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:49:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Flow 'volume_create_manager' (9a74608e-8f48-483e-9a6a-83a06205ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eaa37f-41ab-4276-b9d8-12b4bddd565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eaa37f-41ab-4276-b9d8-12b4bddd565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-847996686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035c556f-1d51-4825-ae68-ecd3efd561dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304ca6d611dc498885d25f2a03e0af26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:00Z,use_quota=True,user_id='a7c80c6c608947cdaac0a5ae18cf3e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45dc73-c119-427c-b2e8-fae3907ddf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45dc73-c119-427c-b2e8-fae3907ddf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1bede3-d95e-4e42-96c0-0f85ec17e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1bede3-d95e-4e42-96c0-0f85ec17e30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035c556f-1d51-4825-ae68-ecd3efd561dd', 'volume_name': 'volume-035c556f-1d51-4825-ae68-ecd3efd561dd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a516e6-337d-4974-b96c-d177f0e38c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a516e6-337d-4974-b96c-d177f0e38c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28880ccd-9b8c-4aae-90db-5875311355db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Volume 035c556f-1d51-4825-ae68-ecd3efd561dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035c556f-1d51-4825-ae68-ecd3efd561dd', 'volume_size': 1} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-847996686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035c556f-1d51-4825-ae68-ecd3efd561dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304ca6d611dc498885d25f2a03e0af26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:00Z,use_quota=True,user_id='a7c80c6c608947cdaac0a5ae18cf3e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Creating volume 035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] casted to osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb Jul 08 01:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:59 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd 1073741824 Jul 08 01:49:59 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:00 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd 1073741824" returned: 0 in 0.922s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:00 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd Jul 08 01:50:00 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:01 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd" returned: 0 in 0.695s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28880ccd-9b8c-4aae-90db-5875311355db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035c556f-1d51-4825-ae68-ecd3efd561dd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880fd657-934e-4ad6-8ff7-bfe42edb5a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Volume volume-035c556f-1d51-4825-ae68-ecd3efd561dd (035c556f-1d51-4825-ae68-ecd3efd561dd): created successfully Jul 08 01:50:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880fd657-934e-4ad6-8ff7-bfe42edb5a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Flow 'volume_create_manager' (9a74608e-8f48-483e-9a6a-83a06205ec30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-14eed8e2-fbe6-40a2-bfb3-79919225ed90 tempest-SnapshotDependencyTests-454411304 None] Created volume successfully. Jul 08 01:50:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Creating offline snapshot 877db474-0902-48e6-bdf4-dd46f813bf2e of volume 035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:50:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcd442a-0daa-40cd-bed8-630b334b2796]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:02 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd Jul 08 01:50:02 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:03 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:03 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e 1G Jul 08 01:50:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd" returned: 0 in 0.919s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:03 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:04 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e 1G" returned: 0 in 1.006s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-035c556f-1d51-4825-ae68-ecd3efd561dd -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:04 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-035c556f-1d51-4825-ae68-ecd3efd561dd -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e Jul 08 01:50:04 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:04 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-035c556f-1d51-4825-ae68-ecd3efd561dd -F qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e" returned: 0 in 0.866s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:05 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e is being set with open permissions: ugo+rw Jul 08 01:50:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:05 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e Jul 08 01:50:05 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:05 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:05 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.info Jul 08 01:50:05 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:06 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.info" returned: 0 in 0.741s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:06 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.info is being set with open permissions: ugo+rw Jul 08 01:50:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:06 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.info Jul 08 01:50:06 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:07 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.info" returned: 0 in 0.670s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0ff550a0-eee1-42a0-81d2-f60ca3633cbb tempest-SnapshotDependencyTests-454411304 None] Create snapshot completed successfully Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Flow 'volume_create_manager' (bc56b97d-e5fd-419c-b4dd-bddaa2ffe8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127a1e1e-a8d2-4b75-afa8-a2d4e2f8d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127a1e1e-a8d2-4b75-afa8-a2d4e2f8d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304ca6d611dc498885d25f2a03e0af26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=877db474-0902-48e6-bdf4-dd46f813bf2e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:08Z,use_quota=True,user_id='a7c80c6c608947cdaac0a5ae18cf3e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391381a-76af-48f8-b843-72d87c192a19),volume_type_id=3391381a-76af-48f8-b843-72d87c192a19)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d8e069-dd11-417a-b580-6e26878dd817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d8e069-dd11-417a-b580-6e26878dd817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0584831a-ffa5-4d2b-b5ae-0e4afc306633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0584831a-ffa5-4d2b-b5ae-0e4afc306633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2', 'volume_name': 'volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2', 'volume_size': 1, 'snapshot_id': '877db474-0902-48e6-bdf4-dd46f813bf2e'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414fc0d4-c52a-4913-8cbc-f3d60c569a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414fc0d4-c52a-4913-8cbc-f3d60c569a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06d7b50-9037-42ee-9ddb-96bf2b876e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Volume e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2', 'volume_size': 1, 'snapshot_id': '877db474-0902-48e6-bdf4-dd46f813bf2e'} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "cinder-quobyte-877db474-0902-48e6-bdf4-dd46f813bf2e-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-877db474-0902-48e6-bdf4-dd46f813bf2e-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Creating volume e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 from snapshot 877db474-0902-48e6-bdf4-dd46f813bf2e {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Selected osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "cinder-quobyte-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] snapshot: 877db474-0902-48e6-bdf4-dd46f813bf2e, volume: e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6ec33c-5ecb-46ed-9485-2dd858a86971]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:08 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e Jul 08 01:50:08 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:09 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e" returned: 0 in 0.825s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-035c556f-1d51-4825-ae68-ecd3efd561dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:50:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:50:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeb26e9-cd12-4269-bfdc-1a3f0b958042]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:09 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd Jul 08 01:50:09 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:09 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd" returned: 0 in 0.805s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:09 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Path /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:50:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:09 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 Jul 08 01:50:09 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:14 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" returned: 0 in 4.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac9ce52-2e42-420f-b5ca-d5437d334bc1]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:14 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd Jul 08 01:50:14 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:15 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd" returned: 0 in 0.951s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:15 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:50:15 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Converted 1024.00 MB image at 205.96 MB/s Jul 08 01:50:15 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 is being set with open permissions: ugo+rw Jul 08 01:50:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:15 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 Jul 08 01:50:15 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:16 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" returned: 0 in 0.648s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" released by "_copy_volume_from_snapshot" :: held 8.295s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-877db474-0902-48e6-bdf4-dd46f813bf2e-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" released by "_create_volume_from_snapshot" :: held 8.330s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.345s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06d7b50-9037-42ee-9ddb-96bf2b876e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2', 'volume_size': 1, 'snapshot_id': '877db474-0902-48e6-bdf4-dd46f813bf2e'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e50569e-30e0-4980-96b1-611e8ed92496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:16 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Volume volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 (e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2): created successfully Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e50569e-30e0-4980-96b1-611e8ed92496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Flow 'volume_create_manager' (bc56b97d-e5fd-419c-b4dd-bddaa2ffe8cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c068187f-fbdc-41ad-8a99-f849bbff2934 tempest-SnapshotDependencyTests-454411304 None] Created volume successfully. Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "cinder-877db474-0902-48e6-bdf4-dd46f813bf2e-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-877db474-0902-48e6-bdf4-dd46f813bf2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "cinder-quobyte-035c556f-1d51-4825-ae68-ecd3efd561dd" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-035c556f-1d51-4825-ae68-ecd3efd561dd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "cinder-quobyte-877db474-0902-48e6-bdf4-dd46f813bf2e" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-877db474-0902-48e6-bdf4-dd46f813bf2e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Deleting offline snapshot 877db474-0902-48e6-bdf4-dd46f813bf2e of volume 035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] snapshot_file for this snap is: volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c90c6f4-ac7c-4006-8c3b-11f8e43b244b]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:17 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e Jul 08 01:50:17 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:17 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e" returned: 0 in 0.869s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-035c556f-1d51-4825-ae68-ecd3efd561dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ce799e-49b1-4cd9-bd9f-5c43629cb2b9]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:18 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd Jul 08 01:50:18 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:18 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd" returned: 0 in 0.899s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:18 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e Jul 08 01:50:18 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:19 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e" returned: 0 in 0.792s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:19 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e Jul 08 01:50:19 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:20 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd.877db474-0902-48e6-bdf4-dd46f813bf2e" returned: 0 in 0.663s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-877db474-0902-48e6-bdf4-dd46f813bf2e" released by "_delete_snapshot" :: held 3.338s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-035c556f-1d51-4825-ae68-ecd3efd561dd" released by "delete_snapshot" :: held 3.367s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:20 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Created reservations ['2b665ecb-2a9b-4b1a-9d41-317caa9c6875', '92bc0190-4451-43d0-8351-ebcec549a083', '7b1e525a-09f5-48dd-9003-207994c7f5d3', '60591f82-bd67-49c4-afbf-ae9b75559de7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Delete snapshot completed successfully. Jul 08 01:50:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a591e290-a1dc-4882-bc6f-901893cfca66 tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-877db474-0902-48e6-bdf4-dd46f813bf2e-delete_snapshot" released by "delete_snapshot" :: held 3.535s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "cinder-035c556f-1d51-4825-ae68-ecd3efd561dd-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-035c556f-1d51-4825-ae68-ecd3efd561dd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "cinder-quobyte-035c556f-1d51-4825-ae68-ecd3efd561dd" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-035c556f-1d51-4825-ae68-ecd3efd561dd" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8732f82-aa4a-450f-8a34-1b2f3077c69f]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:21 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd Jul 08 01:50:21 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:22 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd" returned: 0 in 0.802s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:22 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd Jul 08 01:50:22 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:22 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-035c556f-1d51-4825-ae68-ecd3efd561dd" returned: 0 in 0.698s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-035c556f-1d51-4825-ae68-ecd3efd561dd" released by "delete_volume" :: held 1.575s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Created reservations ['05822151-6d22-4c33-8c17-5a9d984fa1e1', '6d350688-8f7e-4798-aad1-8afeb24b10e5', '0c11905e-c6d2-4500-9481-2cf75a2dc960', '65cb6332-c751-4dd9-bdc3-a622747920db'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:22 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:50:22 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "cinder-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "cinder-quobyte-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88bb873-6f06-41e5-af09-f237232314a4]: (4, 'qcow2') {{(pid=88445) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:23 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:23 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Deleted volume successfully. Jul 08 01:50:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e00e0360-05c2-4761-aa2d-2113054e73ca tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-035c556f-1d51-4825-ae68-ecd3efd561dd-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:23 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 Jul 08 01:50:23 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:24 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" returned: 0 in 0.844s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:24 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2 Jul 08 01:50:24 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:25 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff/volume-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" returned: 0 in 0.711s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-quobyte-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2" released by "delete_volume" :: held 1.601s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Created reservations ['3fe2619d-549f-4066-8a46-ce813eacfeb6', 'ace346b9-9ff2-47bd-91ed-91967f9a7f5d', '9aacbc93-4879-4db9-9a53-2428fc2f60fb', 'f1c2c61a-7f20-4c18-9ce5-b7d8b9d9644d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:25 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:50:25 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:26 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:26 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Deleted volume successfully. Jul 08 01:50:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9735d04e-6380-4fd8-b4af-f906b370c11f tempest-SnapshotDependencyTests-454411304 None] Lock "cinder-e93b74eb-18b6-4a87-9aa5-4ec1e4e700d2-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:35 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:50:36 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=34,cinder:SELECT=21,cinder:DELETE=4,cinder:INSERT=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:50:53 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:50:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4848331a-a441-4892-bfdb-39bd4bcf91bb'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:53 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff Jul 08 01:50:53 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:54 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bd1fb8750ed990a01c60173cacc4fff" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:54 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:50:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:50:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2ced80eb-f508-4cce-8483-47ded9b6daa4 None None] thread info: [<_MainThread(MainThread, started 124276365684864)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}